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Abstract. The lattice model of the Weil representation over non-archimedean local field F of 
odd residual characteristic has been known for decades, and is used to prove the Howe duality 
conjecture for unramified dual pairs when the residue characteristic of F is odd. In this paper, we 
will modify the lattice model of the Weil representation so that it is defined independently of the 
residue characteristic. Although to define the lattice model alone is not enough to prove the Howe 
duality conjecture for even residual characteristic, we will propose a couple of conjectural lemmas 
which imply the Howe duality conjecture for unramified dual pairs for even residual characteristic. 
Also we will give a proof of those lemmas for certain cases, which allow us to prove (a version of) 
the Howe duality conjecture for even residual characteristic for a certain class of representations for 
the dual pair (0(2n), Sp(2n)), where 0(2n) is unramified. We hope this paper serves as a first step 
toward a proof of the Howe duality conjecture for even residual characteristic. 



1. Introduction 

Let F be a non-archimedean local field of characteristic and W be a symplectic space over F 
of dimension 2n. For an additive character ip on F, we let uj^ be the Weil representation of the 
metaplectic cover Sp(VF) of Sp(TF). Let E be either F or a quadratic extension of F. For i = 1,2, 
let (Vj, (— ,— )j) be an ei-Hermitian space over E where t\ £ {±1} and £162 = — 1, and let U(Vi) 
be its isometry group. Assume the pair (U (Vi) , U (V2)) forms an irreducible dual reductive pair in 
Sp(W), so that U(Vi) ■ U(Vi) is a subgroup of Sp(W). We call the restriction of oj^ to the preimage of 
U(Vi) ■ Uiy^) in Sp(VF) also uu. In this introduction just for notational convenience we assume that 
both U(Vi) and [/(V2) split in Sp(W), so we may view ui^ as a representation of U(Vi) ■ U(Vi), or 
even as a representation of U(Vi) x [/(V2) via the multiplication map U(Vi) x [/(V2) — > U(V\) ■ U(V2)- 

For an irreducible admissible representation tx\ of f7(Vi), the maximum tt- isotypic quotient of ui^ 
(as a representation of U(Vi) x t7 (V2)) has the form 

for some (possibly zero) smooth representation Q^{tt) of U(V2)- It is known that 0^(7r) is of finite 
length and hence is admissible. We let 9^,{tt) be the maximal semisimple quotient of Q^pijr). It has 
been conjectured by Howe that 

• 9ip(n) is irreducible whenever Q^(tt) is non-zero. 

• the map tt i— > 9^(tt) is injective on its domain. 

This conjecture has been known as the Howe duality conjecture, and proven by Howe and Waldspurger 
when the residue characteristic of F is odd more than two decades ago f [MVWj . |Hlj . |Waj ). 

The case for even residual characteristic is still widely open in general. To the best of our knowledge, 
the only general result for even residual characteristic is the quarter century old result by Kudla ( |Kuj ) 
in which he shows if tt is supercuspidal, then Q^(tt) is always irreducible. Since then, however, it seems 
no progress has been made, possibly with the exceptions of the recently result by Li-Sun- Tian (LST ) 
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which shows that #^(71") is multiplicity free. Also when the ranks for the groups are very small like 2 
or 3 at most, one can check the Howe duality by hand. 

The proof of the Howe duality conjecture for odd residual characteristic is reproduced in detail by 
Waldspurger in |Wa) . The proof requires what is known as the generalized lattice model of the Weil 
representation and is highly complex. However when the dual pair ([/(Vi), {/(V^)) is "unramified" in 
the sense of |M VWj . which is the same as saying both of the groups U(Vi) and [/(V2) are unramified 
i.e. split over unramified extension of F, one only needs the lattice model of the Weil representation, 
which is much simpler than the generalized lattice model, and hence the proof becomes significantly 
simpler. This proof is reproduced in Chapter 5 of |M VWj . Also another version of the proof is given 
in [Hi"] . 

All of those proofs of the Howe duality conjecture for odd residual characteristic require the (gener- 
alized) lattice model of the Weil representation. One of the crucial obstructions to apply those proofs 
to the case of even residual characteristic is the unavailability of such model. 

In this paper, we modify the known lattice model so that it can be defined even when the residue 
characteristic of F is even. As we will see, however, this is not enough to extend the proof in [MVW1 
Ch. 5] to the case of even residual characteristic, and various technical difficulties arise if one simply 
tries to apply the arguments in |MVW[ Ch. 5] to the case of even residual characteristic. In particular, 
one has to prove a couple of lemmas, which we call "the first and second key lemmas on the lattice 
model", which are the analogues of Theorem 1.4 and Proposition 1.5 in Chapter 5 of MVW, p. 103], 
respectively. 

Let us be more specific. For an unramified dual pair (U(Vi), [/(V2)), there exists a self-dual lattice 
Li of Vi for i = 1, 2, so that A := L\ ®o E is a self-dual lattice of W :— V\ ®e V2 with respect to 
the additive character ip. First we show 

Theorem 1.1. There exists the lattice model (u)^,Sa) of the Weil representation uj^, even when the 
residue characteristic of F is even. 

Here the space S := Sa of the lattice model is a certain set of smooth compactly supported functions 
/ : W x F — >• C on W x F. For each sublattice L C L\ of the self-dual lattice L±, we define Sl to 
be the subspace of Sa consisting of functions whose support is in (L x ®o E ^2) x F, where L x is the 
dual lattice of L. 

The first key lemma roughly says the following: For any sublattice L C Ii, we have the equality 

Utp(H 2 )S l = S' h ^ 

where %2 is the spherical Hecke algebra of U(V2), and S' 11 ^ is the set of functions invariant by the 
subgroup Ji{L) of U(Vi) which is the kernel of the reduction map U(L^-) — > Aut(L _L /I/), where L 1 - 
is the dual lattice of L. (Strictly speaking we need to modify J\{L) by a certain subgroup Ji(L)°, 
which will be defined later in the paper.) The same should hold by switching the roles of Vi and V^- 

The second key lemma is even more of technical nature: First we define Hi(L) to be the kernel of 
the reduction map U(Li) — > Aut(L\/L). Then it turns out that for each w € W, there is a character 
ijjf which naturally arrises in the theory of lattice model. Then the second key lemma says if ip™ = ip w 
for w,w' £ W and both w and w' satisfy a certainly maximality condition, then w and w' have to be 
in the same orbit under the action of the maximal open compact subgroup of U(Vi) on W/A. And 
the same should hold by switching the roles of Vi and V2 ■ 

With those two conjectural lemmas, we can show the following version of the Howe duality principle: 

Theorem 1.2. Modulo the above two conjectural lemmas, the Howe duality conjecture holds indepen- 
dently of the residue characteristic, in the sense that if n is an irreducible admissible representation 
ofU(Vi) and 8^(71-) ^ 0, then 0^(ir) has a unique irreducible non-zero quotient. 
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As we already mentioned, we are not able to prove the two key lemmas in full generality. However, 
if L is of the form L = m k Li, where w is a uniformizer of F and k is an integer with k > 1 + e, where 
e is the ramification index of 2 in F, then the two key lemmas can be proven to the extent necessary 
to prove 

Theorem 1.3 (Main Theorem). Let n be an irreducible admissible representation of O(V), where 
O(V) is quasi-split and split over an unramified extension and dim V = 2n. Let L\ C V be a self-dual 
lattice. Assume 

• 7r Jl < L ) = for all L with L D w k L i; 

• n J i( L ) for L — vj k L 1 for some k with k > 1 + e. 

Then for the dual pair (0(2n), Sp(2n)) ; if Q^,(tt) ^ 0, it has a unique non-zero irreducible quotient. 

In the above theorem we need to assume that the symplectic group has the same rank as the 
orthogonal group. All the conditions we need to impose on this theorem are all of technical nature. 
Also we consider the lifting to smaller rank symplectic groups and prove 

Theorem 1.4. Let tt be an irreducible admissible representation ofO(V), where O(V) is quasi-split 
and split over an unramified extension, with dim V = 2m or dim V = 2m + 1. Assume n is such that 

yJi(L) = q 

for all L 3 2vuLi = v3 1+e L\ for a self-dual lattice L\ C V. Then for the dual pair (O(V), Sp(2n)) 7 (or 
(O(V), Sp(2n))J with m> n, we always have Q^(n) = 0. 

The main structure of this paper is the following: In the next section (Section 2), we will go over 
the formulation of the Heisenberg group and the Weil representation. Our formulation differs from 
the modern convention, but closely follows the one in the original paper by Weil (|W ). In Section 3, 
we will define the lattice model of the Weil representation, which works independently of the residual 
characteristic, and make explicit the action of the metaplectic group on this model. In Section 4, we 
extend some of the lemmas about lattices proven in |MVW[ Ch. 5, II] to the case of even residual 
characteristic, and in Section 5 we will go over the notion of unramified dual pair. In Section 6, we 
formulate the two (conjectural) key lemmas. In Section 7 and 8 we prove the first and second key 
lemmas for the special type of lattices mentioned above namely those L with L C 2wL\ — vo 1+e L\. 
Then finally in Section 9, we give our proof of the main theorem, and in Section 10 we will prove the 
last theorem mentioned above. 



Notations 

Throughout the paper, F will be a non-archimedean local field of characteristic 0, and E will be either 
F or an unramified quadratic extension of F. We let O (resp. Oe) be the ring of integers of F (resp. 
E). We let w be a chosen uniformizer of F, and choose our uniformizer of E to be w as well. Also 
we write V n = w n O and V E = vd u Oe fo each integer n. We fix an additive character ip of F, and r 
be the exponential conductor of ip so that ip is trivial on V r . Also we let 

e = ordp(2), 

so 2 = vj e x unit, and in particular if the residue characteristic of F is even, e is the ramification index 
of 2 in F. 

For each c 6 E, we denote c = c if E = F and c = r(c) if E ^ F where r is the non-trivial element 
in Gal(E/F). 

For e G {±1}, by an e-Hermitian space (V, (— , — )) over E, we mean a finite dimensional vector 
space V over E equipped with a map (-,-}:VxV->£ which is linear on the first argument and 
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antilinear on the second with the property that (vi, v 2 ) — e(v2,Vx). We always assume our e-Hermitian 
space is nondegenerate. We let U(V) be the group of isometries of (V, (— , — )). By a lattice L of V, 
we mean a free 0£-module L whose rank is equal to dims V. 
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2. The Heisenberg group and the Weil representation 

Let (W, (—, — )) be a symplectic space over F of dimension In. In this section, we define the 
Heisenberg group and the Weil representation for W, but in order to construct the lattice model 
of the Weil representation that works for the case of even residual characteristic, we need to adapt 
a different convention. The Heisenberg group H(W) associated with W is usually defined to be 
H(W) = W x F as a set with the group structure given by 

{wi,Z\) ■ (w 2 ,z 2 ) = (wi +w 2 ,z 1 + z 2 + -(wi,w 2 )) 

for (wi 7 Zi) £ H(W), and then one can see that each g £ Sp(W) acts on H(W) by g ■ (w, z) — (gw, z). 
However the \ appearing here makes it impossible to define the lattice model of the Weil representation 
when the residue characteristic of F is even. To get around it, we will define the Heisenberg group 
differently by following the original formulation by Weil (jW)). 
First we need to fix a polarization 

w = w + ®w~, 

and for each element w £ W, we write w = w + + w~ where w + £ W + and w~ £ W~ . With respect 
to this polarization, we define a bilinear form 

(3 : W x W -> F, (wi, w 2 ) H> (wf , w^}. 

Note that /3 is indeed bilinear and f3(wi,w 2 ) — (w^,w 2 ) — (wijW^) but in general (3(wi,w 2 ) ^ 
—/3(w 2 ,wi), but instead we have 

fi{w u w 2 ) - p(w 2 ,wi) = {wi,w 2 ). 
For each j3, we define the Heisenberg group Hp(W) to be the group with underlying set 

Hp(W) — W x F 

where the group operation is given by 

(wi,zi) ■ (W2, z 2 ) = (wi + w 2 , zi + z 2 + (3(wi,w 2 )). 
One can check that the center of H@(W) is {(0, z) : z £ F}. 

Proposition 2.1. For any f3, Hp(W) is isomorphic to the usual Heisenberg group H{W) defined by 
§(-->■ 

Proof. By direct computation, one can check that the map Hp(W) — > H(W) defined by (w, z) n> 
(w,z — \{w + ,w~)) is an isomorphism. □ 

Proposition 2.2. All the Hp(W) are isomorphic to each other. 
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Proof. Of course, this immediately follows from the previous proposition because H(W) is independent 
of j3. But one can also construct an explicit isomorphism as follows: Let W — X Y be another 
polarization. Define j3' : W —> F analogously with respect to this polarization. By Witt's extension 
theorem, there exists g G Sp(W) such that g(W + ) = X and g(W~) = Y. Then one can see that the 
map Hp(W) — > Hpi(W) defined by (w,z) h-> (g(w),z) is a isomorphism. □ 

If we define our Heisenberg group in this way, however, we no longer have f3(gwi, gw?) — (3{w\, w 2 ) 
for every g G Sp(M / ), and hence Sp(M / ) does not act in any obvious way. Namely the discrepancy 
(3(gwi,gw 2 ) — P(wi,w 2 ) has to be taken care of. For this purpose, let us define, for each g G Sp(W), 
Ti g to be the set of all continuous functions a : W — > F such that 

a(wi + w 2 ) - a(wi) - a{w 2 ) = j3(gwi,gw 2 ) - P(wi,w 2 ). 

Such function a is a character of second degree in the sense of [W . Following Weil ((WJ), we define 
the linear pseudosymplectic group Ps(M / ) by 

Ps(W) :={( S , a ): 9 eSp(n«eS s }, 

where the group structure is given by 

"1) ' (.92, a 2 ) = (.91.92, 9 2 X ■ &i + a 2 ) 

where g^ 1 ■ ot\ is defined by 

g 2 x ■ ai{w) = ai(g 2 w). 

Then Ps(W) acts on Hp(W) as 

(g, a) ■ (w, z) = (gw, z + a(w)). 

One can verify that this is indeed an action. 

We have the obvious map Ps(VK) — > Sp(W) given by (g, a) i-> g. Weil shows that the sequence 

-> W* ->• Ps{W) -> Sp(PF) -> 

is exact, where W* — Homp(W, F) (see |W1 p. 150]). Moreover, he shows that the exact sequence 
splits by the following lemma. 

Lemma 2.3. Let g G Sp(M^) have the matrix representation 

a b 
c d 

with respect to the polarization W — W + © W~ . Let 

(2.4) ct g (w + + w~) = —(aw + , cw + ) + ~^{bw~ , dw~) + (bw~, cw + ). 

Then a g G £„. Moreover, the map g *— > (g,a g ) gives a homomorphism from Sp(VF) to Ps(W), namely 

otgh = ■ a g + a h for all g,h G Sp(W). 

Proof. Though this is proven in |W[ Sec 4], it is not so easy to read it off from there due to the 
notational discrepancy. Hence we give a proof here with our notations. First let us show a g G S g . 
Let W\ = w~l + Wi and w 2 = + be in W — W + © W~. First we need to show that a g G S s , 
namely 

a g (wi + w 2 ) - a g (wi) - a g (w 2 ) - j3{gw ll gw 2 ) + (3(wi,w 2 ) = 0. 
By keeping in mind 

£(101,103) = (wf,W2) = (gwf,gw 2 ) = (awf +cw^,bw 2 + dw^) = (aw^dw^) + (cwf,bw 2 ), 
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one can show by direct computations that 

a g (wi + w 2 ) ~ ag(wi) - a g (w 2 ) ~ (3(gwi,gw 2 ) + fi{wi,w 2 ) 



■^{o-wt ,cwt) + \ ( aw 2i cw i) - \ ( bw i > dw 2 ) + \ ( hw 2 ,dw 1 ). 



Here notice that 



= \ { aw 2 + CW 2 . aW l ) + \ ( aW 2 + CW 2 > CW l) 

= i {aw ^ + cw^ ,aw^ + cw~l ) 
= 0. 

Similarly one can show that — ^(bw^jdw^) + ^(bw^ ,dw^) = 0. Hence we have shown a g G T, g . 

To show that the map g n> (g, a g ) is a group homomorphism is even a more straight forward 
computation, though tedious. □ 

Remark 2.5. Let us mention that in the above lemma, if b = c = 0, namely g is in the Siegel Levi, 
then a g = 0. 

We would like to describe (#, a s ) _1 for each g G Sp(VF). For this purpose, dehne a 9 = —a g og" 1 . 
Namely it is the map a 9 : W — > F defined by 

a 9 (w) = -a g {g~ 1 w) 

for w G W. Then we have 

Lemma 2.6. For each g G Sp(W), 

(1) a»6S rl ; 

(2) (g~\a 9 ) = (g,^)- 1 mVs(W). 
Proof. (1) For 101,102 G W, we have 

a 9 (wi + w 2 ) - a 9 (wx) - a 9 (w 2 ) = -a g (g~ 1 (wi + w 2 )) + a g (g~ 1 w 1 ) + a g (g~ 1 w 2 ) 

= ~/3(gg~ 1 w 1 ,gg~ 1 w 2 ) + (3(g~ 1 w 1 , g~ 1 w 2 ) 
= P(g~ 1 wi,g~ 1 W2) - y8 (101,102). 

Hence a 9 G S 9 -i- 

(2) By part (1), one knows that indeed {g~ x ,a 9 ) G Ps(W). Now consider 

(ff,a 3 )(5~\a s ) = (l,5-afl + a s ), 

and for all w G W, 

(g ■ a g + a 9 )(w) = a^g^w) - a g {g~ 1 w) = 0, 
and so g ■ a g + a 9 = 0. Hence (<7 _1 , a 9 ) = (5, a 9 ) _1 - □ 

Remark 2.7. Throughout this paper, we view Sp(W) as a subgroup of Ps(W) via the splitting g ^ 
(g,a g ), and when we denote an element g G Sp(VF) it should be considered as an abbreviation of 
(g,a g ). In particular g^ 1 has to be considered as (g ,a 9 ) rather than (g ,a g -i). Note that in 
general a g -i ^ a 9 . 
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Recall 

Theorem 2.8 (Stone- Von-Neumann). For a fixed additive character ip, there is a unique (up to 
isomorphism) smooth irreducible representation pw of Hp(W) such that the element (0,z) in the 
center acts as multiplication by ip{z). 

Via the splitting Sp(W / ) — > Ps(W), the symplectic group Sp(VK) acts on Hp(W), namely 

g ■ (w, z) = (gw, z + a g (w)) 

for g G Sp(VK) and (w,z) G Hp(W). This, combined with the Stone- Von-Neumann theorem, gives 
rise to the projective representation Sp(VF) — > PGL(pw)- This projective representation defines the 
metaplectic cover Sp(VF) which is the subgroup of Sp(VK) x GL(pw) that consists of pairs (g,M g ) 
where g G Sp(H / ) and M g G GL(pw) are such that 

M g o p w (h) = pw(g ■ h) o M g 

for all h G Hp(W), where g ■ h is the above mentioned action of Sp(VF) on Hp(W). Note that for each 
fixed g G Sp(W), the map h M> pw(g • h) defines another irreducible representation of Hp(W), and 
hence by Stone- Von- Neumann, this is equivalence to pw- Let uj^ be the representation of Sp(VF) on 
the space of pw given by 

u^(g,M g ) :=M g . 

This representation is called the Weil representation of Sp(VK). Also note that we have the short exact 
sequence 

f -> C x -> Sp(W) -> Sp(W) -> f , 

where the map C x — > Sp(VF) is the inclusion z i-> (f,zld) and the map Sp(VF) — > Sp(W) is the 
projection {g, M g ) t- > g. 

Remark 2.9. The Weil representation uj^ can be shown to be independent of the choice of j3. Also 
the metaplectic group Sp(W) can be shown to be independent of tp and (3. 

3. The Lattice Model of the Weil representation 

Let A be a lattice of W, namely a free O-module of W of rank equal to dim W. We define the dual 
A 1 - of A with respect to an integer r by 

A 1 - := {w G W : (a, w) G P r for all a G A}. 

We usually assume r to be the exponential conductor of our fixed additive character tp, and then the 
condition (a, w) G V r for all a G A is equivalent to ip((a, w)) = 1 for all a G A. We say a lattice A is 
self-dual if A = A ± . Note that if A is self-dual, then (a\, a 2 ) G V r for all a\, a 2 G A. Given a self-dual 
lattice A (with respect to r) one can always choose the polarization W — W + W~ such that we 
have the decomposition A = (AnW + )(B(AnW~). Conversely for each polarization W — W + ®W~ , 
one can always find a self-dual lattice A with respect to r so that A = (A n W + ) (B (Ad W~). When 
a self-dual lattice A is decomposed in this way with resect to the polarization W — W + ® W~ , we 
say that A is compatible with the polarization. If A is compatible with the polarization defining j3, 
one can see that /3(ai, a 2 ) G V r for all a\, a 2 G A. 

For a self-dual lattice A compatible with our fixed polarization of W, we let 

Hp (A) := Ax F C Hp{W). 

Then Hp(A) is a subgroup of Hp(W). Define the character 

ip A ■Hp(A) ^C x , (a, z) i— > ip(z). 
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Since A is compatible with the polarization, one can see that this map is indeed a character. Moreover 
one can see that if) a cannot be extended to any bigger subgroup than Hp (A). Consider the induced 
representation 

S A ■= ind^l^-ipA, 
where the induction is compact induction. Then we have 

Proposition 3.1. The above induced representation provides a model of the Heisenberg representation. 

Proof. It is immediate that the central character is ip. Hence it suffices to show that it is irreducible. 
The proof is essentially the same as the usual lattice model (see }MVW( p. 29]). Yet, since the proof 
is not identical, we will give the detail here. 

Let L be an open compact subgroup of W and w £ W be fixed. Define a function f w l ■ Hp (W) —> C 

by 



fw,L( w ' ) Z ) = 




if w' G A - 
otherwise. 



Then f w ^ G Sa- As in [MVW1 p. 29], the space Sa is spanned by functions of this form. 

Let S' C Sa be a non-zero subspace invariant under the action of Hp(W). Let w G W be any. 
Then one can always find / G S' such that f(w, 0) ^ by translating. By smoothness, there exists 
a open compact subgroup L w C W, viewed as a subgroup of Hp(W), which fixes /. Let L C L w be 
an open subgroup of L w . Now by the theory of Fourier transforms, there exists a locally constant 
function tp on A such that for all w' G W, we have 



%/j((w' ,a))ip(a) da = 



if w' G A 4 
otherwise, 



because one can identify the Pontryagin dual of W/A with A. Now define a function F v f : W x F 

by 



F vJ {w',z):=^{z) / /((to',0))(a,0)Mo)do 
J a 

= 1>(z) f f((a + v/,p(v/,a)))<p(a) da 

J A 

= i>(g) f f((a,j3(w',a)-j3(a,w'))(w',0))cp(a)da 

J A 

= j,(z) (J iPiPiw', a) - (3(a, w'))<p(a) da^j f(w', 0) 
= ^(z)( [ il>((w',a))<p(a) da] f(w',0) 



_U(z)f(v/,0), if w' G A + w + L 
1 0, otherwise. 

Hence F$ f is a scalar multiple of f Wt L. But w is arbitrary and hence L can be arbitrary. As we 
mentioned, the functions of the form f Wi L generate the space SU, i.e. S' — S. □ 

Remark 3.2. The reader may wonder what would go wrong if one uses the usual Heisenberg group 
H(W) but with the additive character ip2, so that the character (a, z) h4 ip2(z) is defined. (Also 
for this matter, this is essentially equivalent to defining the Heisenberg group using (— , — ) instead of 
i(— ,— ).) But if one uses ip2 (or (—,—)), the above proof would not work. Indeed, in this case the 
induced representation would be reducible. 
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We call (pw,Sa) the lattice model of the Hcisenberg representation. Accordingly, the Weil rep- 
resentation of Sp(VF) realized in the space Sa is called the lattice model of the Weil representation. 
(Strictly speaking the lattice model Sa is also dependent on the choice of j3, but we avoid the notation 
Sa,/3, assuming (3 is fixed.) 

Let us note that each element / g Sa is a smooth compactly supported (modulo the center) 
function / : W x F — > C such that 

f(a + w,0) = ij(-/3(a,w))f(w,0) 

for w £ W and a £ A. (Here note that (a + w,0) = (a, —f3(a, w))(w, 0).) 
For each w £ W, we let 

(3.3) s w — the unique function in Sa with supp(s„,) = (A + w) x F such that s w (w, 0) = 1. 

This function plays an important role through the paper. 

To make explicit the action of M g on the lattice model, we need to use a 9 as in Lemma l2.6l Using 
a 9 , we can describe the action of M g on the space Sa of the lattice model explicitly as follows: For 
f E Sa and (w, z) £ Hp{W), define an endomorphism M g : Sa — > Sa by 

(3.4) M g of(w,z)= ip{l3(a,w))f(g~ 1 (a + w),z + a 9 (a + w)) da 

Ja/a, 

where w £ W, z € F, g € Sp(W) and 

A g = {a e A : ga E A and a g (a) £ V r }. 

One can check that A g is a subgroup of A, because if a, b £ A g and so ga, gb £ A, then a g (a + b) = 
P(ga, gb) — /?(a, b) + a g (a) + a g (b) and each term here is in V r . Note that 2{gA n A) C A g and A/A g 
is a finite set. To show the integral can be indeed defined over A/A g , i.e. the integral is invariant 
under A g , is a direct computation. 

Remark 3.5. Recall that each g £ Sp(W) has to be interpreted as (g,a g ) £ Ps(W), and so g^ 1 is 
actually (g,a 9 ) _1 = (g _1 ,Q! 9 ) instead of(g ,a g -i). (See Remark \2.7\ ) Hence M g -i is given by 

M g -i°f(w,z)= / ip(P(a,w))f(g(a + w),z + a g (a + w)) da, 
where A g -i ={aei: g~ 1 a £ A and a 9 (a) £ V r }. 

Proposition 3.6. The map M g is indeed well-defined, i.e. M g o / £ Sa for all f £ Sa- 

Proof. Since the integral defining M g o / is a finite sum, it is clear that it is smooth with compact 
support modulo the center. Hence we have only to show M g of(a' + w, 0) = %f)(—^(a', w))M g o f(w, 0) 
for all a' 6 A. But 

M g o f(a' + w,0) = / ^((3(0,^ + w))f(g~ 1 (a + a' + w),a 9 (a + a' + w)) da 
= / ip{(3(a- a',a' + w))f(g~ 1 (a + w),a 9 (a + w)) da 

J A/Ag 

— / ip{[3{a, w) + f3(a, a) — /3(a', a') — f3(a , w))f(g~ (a + w), a 9 (a + w)) da 

J A/Ag 

= (3(a', w)) / ip(/3(a, w))f(g~ 1 (a + w), z + a 9 {a + w)) da 

J A/Ag 

= ^{-P{a',w))M g of(w,Q), 
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where for the second equality we used the invariance of the measure on A and for the fourth, we used 
/3(a, a') £ V r and f3(a', a') £ V r '. □ 

Proposition 3.7. For each g £ Sp(M /r ), the map M g is not identically zero. 

Proof. Consider the function sq £ Sa, i-e. set w — in f|3 . 3|) . Then so(a, 0) = 1 for all a £ A. We 
have 

M g oso(0,0)= / So(g~ 1 a, a 9 {a))da 

JA/A g 

so(g~ 1 a, a 9 (a))da 

gAnA/Ag 



ip(a 9 {a))da. 

gAnA/Ag 

Now the map ip o a 9 is a non-degenerate character of second degree on the finite group gA n A/A g in 
the sense of jW]. Hence by [R[ Theorem A. 2 (5)], we have 



f ip(a 9 (aj)da = \gA n A/Ag] 1 ' 2 ^ o 

JaAnA/Ao 



I g An A/ A 

where 7(f/' ° a 9 ) is the Weil index of ip o a 9 . (See [Rl Appendix] for details.) In particular, it is 
non-zero. Thus M g o sq(0, 0) ^ 0. The proposition follows. □ 

Then we have 

Proposition 3.8. For the above defined M g , we have M g op w (h) — pw(g-h)oM g for all h £ Hp(W), 
namely the element (g,M g ) is indeed in Sp(W) and M g defines the action for the Weil representation. 

Proof. Note that since pw is irreducible, if we can show M g o pw(h) = pw{g • h) o M g for all h, it will 
imply M g is invertible and hence (g, M g ) is indeed in Sp(W). 

Let (to, z) £ Hp(W), and / £ Sa- Also let h = (w', z 1 ) £ Hp(W). Recalling g -h = g ■ (V, z') = 
{gw 1 , z' + a g (w')), we have 

(pw{g ■ h) o M g ) o f(w,z) 
= Pw(g ■ h){M g o f)(w,z) 

= M g Z )(9 W ', z ' + a g(w'))) 

= M g o f(w + gw', z + z' + a g (w') + (3(w, gw')) 

ip(f3(a, w + gw'))f(g~ (a + w + gw'), z + z' + a g (w') + (3(w, gw') + a 9 (a + w + gw')) da 



il}{(3(a,w))f{g- l (a + w) + w' , z + z' + a g (w') + f3(w,gw') + a 9 (a + w + gw') + (3(a,gw')) da 
i/j(P(a, w)) f (g" 1 (a + w) + w' , z + z' + a g (w') + a 9 {a + w + gw') + f3(w + a, gw')) da, 

where all the integrals are over A/A g . 
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On the other hand, 

(M g o p w (h))f(w, z) 

ip{0(a, w))p{w' ,z')f(g^ 1 (a + to), z + a 9 (a + to)) da 
r( <(". (i ) )f((g~ 1 (a + w),z + a 9 (a + w))(w',z')) da 

ip(J3(a, w))f(g (a + to) + to', 2 + z' + a 9 (a + to) + (3(g^ 1 (a + to), to')) cia, 



where again all the integrals are over A/A g . 

In order for us to show that those two are equal, it suffices to show 

a g (w') + a 9 {a + to + .gto') + f3(w + a, gw') = a 9 [a + to) + f3(g~ 1 (a + to), to'), 

namely 

a 9 (a + to + gto') — a 9 (a + to) + a g (w') — f3(g^ 1 (a + to), to') — f3(w + a, gw'). 
But this follows because a 9 (to') = —a 9 {gw') and a 9 G £ g -i. □ 

Let us define 

T A := {g e Sp(W) : gA C A}. 

One can see that Fa is an open compact subgroup of Sp(W). Note that the condition gA C A implies 
gA = A because g is an isometry and hence preserves volume. (This also applies to any lattice. See 
for example [Ql §82:12].) Also we have T A = Sp 2n (0). If g G T A , then 

M g of(w,z)— / tp((3(a,w) — (3{g~ 1 a, g~ 1 w) + a 9 (a + w))f(g~ 1 w 7 z) da 

J A/Ag 

^{a 9 {a) + a a {w))f{g- l w, z) da 

\ 1, 

VKa^a))/^- 1 ™, z + a 9 (w)) da 

ip{a 9 {a)) da) /(g _1 to, z + a 9 (to)). 
. A/A g J 

where to obtain the second equality we used the property that a 9 G E„-i. This implies 

Proposition 3.9. Each g G Ta acts on f G SU by (non-zero scalar multiple of) translation. To be 
more precise, 

M g °f{w,z)= ( / iP(a 9 (a)) da ) ■ /{g^w, z + a 9 (to)). 
\JA/A g J 

From the above integral formula for M g , it is important to know when we have %p{a 9 {a)) = 1 for 
all a G A or equivalently a 9 (a) G V r for all a £ A. For this purpose, let us start with 

Lemma 3.10. Let B be a (not necessarily self-dual) lattice ofW. Then the set 

G B ■= {g G Sp(VT) : a g (w) G V r for all to G B} 

is open and closed. (We do not know if it is a group.) 
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Proof. For each w 6 B, consider the continuous map f w : Sp(W) —> F defined by f w {g) = ot g {w). 
Then 

Gb = f) f~ l {V r )- 

Note that is open and closed, so Gb is closed. Next by looking at the description of a g (w) in 

(|2.4[) . one can see that f^ 1 (V r ) Q f^HF r ) for all w' £ Ow. Since B is compact, we have B = \J i Owi 
for some finite union. So Gs = fl« fw l {^ r )^ which is open. □ 

Now let us define 

:= G A n T A = {g £ T A : a g (a) 6 V r for all a e A}. 

Here let us emphasize that each g £ Ta C Sp(VF) should be interpreted as (g,a g ) € Ps(M / ). (See 
Remark O) 

Lemma 3.11. is an open compact subgroup ofSp(W). 

Proof. By the above lemma and the fact that Ta is open and compact, one can conclude that is 
open and compact. 

To show it is a subgroup, let g,h £ T° A . For a £ A, we have a g h(a) = hr x ■ a g (a) + cth(a) = 
a g (ha) + ah(a) € V r because ha € A. Hence gh 6 T^. Now let g € T^. To show g^ 1 S T^, one needs 
to show a 9 (a) E V for all a £ A. (Here what is needed is not a g -i(a) € "P r ! See Remark 12.71 ) But 
since a 9 (a) — —a g (g^ 1 a), and g _1 a G A, we have — a g (g^ 1 a) £ V r . Hence T° A is a subgroup. □ 

Now for the integral defining M g , if we choose the measure da so that the volume of A/A g is 1, one 
has 

M g o f(w, z) = f{g- l w, z + a g (w)) for all g e T^. 

Note that 

M ff -i o f(w, z) = /(gw, z + a g (w)). 
by Remark 13.51 One can check that for g,h G T^, we have M g h o f = Mh o (M s o /) by using 
Qgh — h~ l ■ a g + ah- This shows T A splits in the metaplectic cover Sp(H r ). 

Indeed if the residue characteristic of F is odd, one can see ip(a 9 (a)) = 1 for any g € Ta and a 6 A. 
This is because from the explicit description of a g as in (|2.4[) together with the fact that ^ is a unit 
in O, one can see that all the three terms in the definition of a g (a) are in V r . Hence T° A — Ta- So 
this explains the well-known splitting of Sp(O) in Sp(W). 

If the residue characteristic of F is even, we no longer have ip(a 9 (a)) = 1 for every g E Ta and 
a G A. Yet, the above lemma shows that for a sufficiently small open compact subgroup T^of Ta, 
we do have ip{a 9 {a)) = 1 for any g G T A and any a £ A. Hence we have the analogous splitting of 
this open compact subgroup, which also explains the well-known fact that a certain open compact 
subgroup of Sp(IF) splits in Sp(I4 7 ) for the case of even residual characteristic. 

Remark 3.12. Not only the group T A but also various other subgroups of Sj>(W) are known to be 
split in the metaplectic cover Sp(W). Whenever H is a subgroup of Sp(W) which splits in Sp(W), 
for each h £ H and f £ Sa we usually denote Mh o f by w^,{h)f or simply uj{h)f because the additive 
character ip is fixed throughout the paper. 

4. On lattices 

In this section we let (V, (— , — )) be an e-Hermitian space over E, where E is either F or a quadratic 
extension of F . In particular, we have 

(cv, c'v') = cd{v, v 1 ) and (v, v') — e(v', v) 
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for v, v' G V and c, c' G E. (Recall from the notation section that for each c 6 E, we denote c = c if 
E = F, and c = r(c) where t is the nontrivial element in Gal(E/F) if E is a quadratic extension of 
F.) We always assume that E is unramified over F when E ^ F. 

By a lattice L of V, we mean a free O^-module of rank equal to dim V. For any lattice L C V, we 
define the dual lattice L with respect to an integer r by 

L L = {v G V : (t>, Z) G 7>£ for all I G L}. 

(In this paper r is usually reserved for the exponential conductor of ip but in this section we use r for 
any fixed integer.) A lattice L is called a self-dual lattice (with respect to r) if L = i. 

Not every e-Hermitian space has a self-dual lattice, and even when it does, we sometimes need 
some restriction on r. To be specific, we have 

Lemma 4.1. An e-Hermitian space (V, ( , )) admits a self-dual lattice (with an occasional restriction 
on r) if it is one of the following: 

(a) V is symplectic, namely E — F and e = — 1. (r can be any.) 

(b) V is symmetric, namely E = F and e = 1, where the anisotropic part V a is one of the following: 

- V a = 0; (r can be any.) 

- V a = F and (a, b) — nab for a, b € F where i] G O x ; (r has to be even.) 

- V a = F' where F' is an unramified quadratic extension of F equipped with the norm form, 
namely for x,y G F' , we have (x,y) — \(xy + xy) where the bar is the conjugation for the 
quadratic extension F' / F. (r has to be even.) 

(c) V is Hermitian, namely E is a quadratic unramified extension over F and e — ±1, where the 
anisotropic part V a is one of the following: 

- V a = 0; (r can be any.) 

- V a = E equipped with the norm form if e = 1, namely (x, y) = xy for x, y £ E, and r\ times the 
norm form if e = —1 where r] is an element in such that fj — —rj, namely (x, y) — rjxy. (r 
has to be even.) 

Proof. This list is as in |MVW[ p. 100], although there it is always assumed r = 0. But for later 
convenience, let us describe the self-dual lattices for all the cases in detail. 

(a) V is symplectic; Then dim V = even = 2n and V admits a basis {ei, . . . , e„, /i, . . . , f n } so that 
(ei, fj) = 5vjW r , (a, ej) = (fi, fj) = 0, and further 

L = span c {ei, . . . , e„, fx, . . . , /„}. 

(b) V is symmetric; 

- V a — 0; Then dim V = even = 2n and V admits a basis {ex, . . . , e„, /i, . . . , /„} so that (e,, fj) = 
SijW r and (a, ej) — (fi, fj) — 0, and further 

L = span {ei, . . . , e n , ft,..., /»}. 

- V a = F; Then dim V = odd = 2n + 1 and V admits a basis {ei, . . . , e„, f%,..., f n , v} with 
V a = span F {u} where v = w r / 2 so that (ei,fj) = 5 i3 m r , (ei,e 3 ) = (fi,fj) = (ei,v) = (fi,v) =0, 
and (v,v) = nw r (assuming r is even), and further 

L = span {ei, . . . ,e„,/i, . . .,/„,«}. 

- V a = F 1 ; First note that since F' is unramified over F, we can write F 1 = F®r)F where r\ G F' is 
such that nfj G O x . Then dim V = even = 2n+2 and V admits a basis {ei, . . . , e„, /i, ...,/„, v\, V2} 
with V° = span F {«i, W2} where v\ — ■uj t ^ 2 and — rjw r / 2 so that (ei, fj) = 5ij-uo r , (ej,e_y) = 
(fiifj) = (e»v) = (fi,Vi) = (vi,v 2 ) = 0, (vi,Vi) = w r and (v 2 ,v 2 ) = -rfrpzf ', and further 

L = span {ei,...,e„,/i,..., f n ,v\, v 2 }. 

(c) V is Hermitian; 
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- V a = 0; Then dims V = even = 2n, and V admits an l?-basis {ei, . . . , e„, /i, . . . , /„} so that 
(ei,fj) = 8 l3 w r and (ei,ej) = (fi,fj) = 0, and further 

L = span OB {ei, . . . , e„, /i, . . . , /„}. 

- V a = E; We let v = w r ^ 2 . We have {v,v} — uw r for some unit u £ 0^. Then dim^V = 
odd = 2n + 1, and V admits an i?-basis {ei, e„, /i, ...,/„, w} so that (e,, fj) — Sijvu r , 
(ei,ej) = (fi,fj) = (ei,v) = (fi,v) = and (v,v) = um r , and further 

L = span 0f ,{ei, . . . , e„, /i, . . . , /„, v}. 

□ 

From this lemma, one can conclude 

Lemma 4.2. Let L C V 6e a self-dual lattice ofV. Then there is a decomposition V = V + ©V a ©V~, 
where V a is the anisotropic part and both V + and V~ are totally isotropic of the same dimension, so 
that V + © V~ is a product of copies of the e-Hermitian hyperbolic planes, such that 

l = v+ n L © v a n L © v- n L. 

We often write 

L + =V + r\L, L a = v a nL, L-=v~nL. 



We will recall some of the properties of self-dual lattices, all of which are essentially in |MVW[ 
p. 10 7- 11 2], though in jMVW] it is always assumed r = 0. 

Note that the quotient L/wL is viewed as an e-Hermitian space over the residue field Oe/tzOe 
by reducing vj~ r (— , — ) mod wOe- For each v S V, we denote by v the image of v in L/vcL. 

Let us mention a couple of properties on the e— Hermitian spaces over the finite field Oe/^Oe- 

Lemma 4.3. Let L := L/voL be the e— Hermitian spaces over the finite field Oe/vjOe- 

(1) Assume X is a totally isotropic subspace of L. Then there exist subspaces Y and L sucht that 
Y is totally isotropic with dimY — diml", and we have the decomposition L — X © L ®Y 
where X © Y is orthogonal to L . 

(2) Let X and X be two subspaces of L with dimX = dimX . Then any isometry X — > X can 
be extended to an isometry on L. 

Proof. Both of them are well-known when the characteristic of the residue field Oe/~cuOe is odd. 
When the characteristic is even, it does not seem to be well-known. First of all, let us denote the 
corresponding form by &(— , — ) := zu~ r (— , — ). If E = F, then the form b is always symmetric because 
e = 1 in Oe/vjOe- Clearly b is non-degenerate. Then part (1) is [Kj Proposition 1.2.2] and part (2) 
is [H Corollary 1.2.1]. 

If E ^ F, then Dieudonne in [Dj p. 21] has shown that these two properties hold if b(x, x) is a trace 
in Oe/vjOe for all x € L, namely for each ieL there exists a £ Oe/vjOe such that b(x,x) — a + a, 
where a is the Galois conjugate of a for the quadratic extension Oe/^Oe over O/wO. But considering 
e = 1, we always have b(x, x) = b(x,x) and so b(x, x) £ O/ujO. The condition is satisfied because the 
trace map Oe/^Oe — > O/wO is surjective. □ 

Lemma 4.4. Let v\, ■ ■ ■ ,Vk £ L be such that the reductions v\, . . . ,Vk in L/wL are linearly indepen- 
dent over the residue field. Then \y\, . . . , Vk} can be extended to a basis of L. 



Proof. This is an elementary exercise. 



□ 
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The following lemma, which is an extension of MVW, Proposition II. 2, p. 107] is crucial to our 
computations. 

Lemma 4.5. For a self-dual lattice L (with respect to r) of V, let v\, . . . , v s G L, t%, . . . ,t s e Z and 

M = (rriij) an s x s matrix with coefficients in Oe- Suppose 

(1) V\ , . . . , v s are linearly independent over the residue field; 

(2) 1 + e < ti < ■ ■ ■ < t s ; 

(3) niij = ernji for all 1 < i,j ' < s; 

(4) nriij = (vi,Vj) mod V r E for all 1 < i ^ j < s; 

(5) m u ee (vi,Vi) mod r p r + u+e for all i G {1, . . . , s}. 
Then there exist v[ , . . . , v' s € L such that 

(6) v[ — Vi G w t% L for all i; 

(7) rriij = (v'^v'j) for all 1 < i, j < s. 

Proof. When the residue characteristic of F is odd, this is }MVW( Proposition II. 2, p. 107] except 
that in }MVWj it is always assumed r = 0. For the case of even residual characteristic, one needs 
to slightly modify the argument there, and we need the condition (5), which can be absorbed by the 
condition (4) in the case of odd residual characteristic. In any case, since the proof is only a slight 
modification of the one given in M VW] . we will repeat only the essentially point. The basic idea is 
to construct a sequence of vectors Vi(t) for each i G {1, . . . , s} where t G 1>\ such that 

(a) Vi(t) — Vi G w li L; 

(b) Vi(t) - Vi(t - 1) G w^-^L for t > 2; 

(c) (vi(t), vj(t)) ee rriij mod for all 1 < i ^ j < s. 

(d) (Vi(t), Vi(t)) ee m u mod V E +r+e for all G {1, . . . , s}. 

The condition (b) guarantees the sequence Vi(t) is Cauchy and hence converges to some v^, and the 
conditions (a) (c) and (d) guarantee v[ has the desired property. 

The sequence Vi(t) is constructed by recursion as follows. First by Lemma 14.41 we can extend 
{vx, . . . , v s } to a basis . . . , v n } of L. Choose a dual basis {v^ , . . . , v *} of L, so that (wj, v*) = zu r 5ij. 
Define Vi(t) by 



Vi{t) 




i{t<ti 



where 



a k i(t) = w r (m ki - (v k (t - l),Vi(t - 1))) if i < k; 

a u (t) = -tt7 1 -*- r (m ii - (Vi(t - l),Vi(t - 1)}). 

(Let us mention that in }MVW| p. 108] there is a typo in the definition of Vi(t). The summation has 
to start with i instead of i + 1.) Note that aji(t) G Oe thanks to the condition (c) and (d). Also 
note that to obtain (c) and (d) at each step, one needs U > 1 + e. By definition of Vi(t), one has 
Vi(t) — Vi G w tl L if t < ti, and Uj(t)— Vi = zu t ^ 1 L C m fi L if t > ti. So the condition (a) is satisfied. □ 

This lemma is very unfortunate in that the restriction ti > 1 + e will not allow us to apply many 
of the computations in MVW] to the case of even residual characteristic. However, if we assume V is 
symplectic, we have 

Lemma 4.6. IfV is symplectic in the above lemma, one can assume ti > 1 instead ofU > 1 + e, and 
can suppress the condition (5). 
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Proof. If V is symplectic, one can simply take au(t) — for all t. (Of course, always m« = 0.) □ 
This implies 

Lemma 4.7. For a self-dual lattice L (with respect to r) of V , let vi,...,v n G L, and t G Z >0 . 
Further assume V is symplectic if the residue characteristic of F is even. Suppose 

(1) Vi, . . . ,v n are linearly independent over the residue field; 

(2) For all i, j G {1, . . . , a}, (v u v t ) = mod P r E +t . 

Then there exist elements v[ . . . v' n G L and subspaces X, V° , Y ofV such that 

(3) {i4 • ■ -v' n } is a basis of X over E; 

(4) we have the orthogonal decomposition W = X © V° © Y such that X (BY is totally isotropic; 

(5) l = l n x © l n v° © l n y ; 

( 6) for all i = 1, . . . , n, we have v[ — v G w t L. 

Proof. This can be proven in the same way as [MVWi Corollary II. 3] using the previous lemma and 
Lemma 14.31 □ 

One reason we have to assume V2 is symplectic in our main theorem is the unavailability of this 
lemma for the other types of spaces. 
Lemma 14.61 also implies 

Lemma 4.8. Let L be a self-dual lattice ofV, where V is either symplectic or symmetric with V a = 
when the residue characteristic is even. Let vi , . . . , v s and are vectors in V such that 

(1) V\ , . . . , v' s are linearly independent over the residue field; 

(2) v'i, . . . , v' s are linearly independent over the residue field; 

(3) (vi,Vj) = (v'^v'j) for alli,j G {l,...,s}. 

Then there exists u G U(V) such that u(L) — L and u{vi) = v[ for all i G {1, . . . , s}. 

Proof. This is [M VWI Corollary II. 5, p. Ill] when the residue characteristic is odd. If the residue 
characteristic is even and V is symplectic, one can prove it in the same way as the case of odd residual 
characteristic by using Lemma 14.61 For the other case, unfortunately, the same proof does not work 
because of the restriction ti > 1 + e in Lemma 14.51 However if V is symmetric and V a — 0, then 
this lemma is simply Witt's extension theorem for self-dual lattices, which is known to hold. (See, for 
example, Corollary 5.4.1 of [K].) □ 

As the last thing in this section, let us introduce the notion of admissible lattices and some of their 
properties. 

Definition 4.9. Assume V is such that V a = 0. We say a (not necessarily self-dual) lattice L C V is 
"admissible" if L = L + + L~ , where recall L + = L n V + and L~ = L n V~. 

Note that for any lattice L with L a — 0, we always have L C L + + L~ , but the inclusion might be 
strict. A self-dual lattice is always admissible. 
We need to quote a few lemmas: 

Lemma 4.10. Assume V is such that V a = 0. A lattice LofV is admissible if and only if L is. 

Proof. Assume L is admissible, so L = L + + L~ . Let / G L . We need to show l + G L . Let 
m = m + + mT G L. Note that since L is admissible, m~ G L, and so (I, mr) G V T . So we have 

(l + ,m) = (l + ,m+ + rrT) = (l + ,m-) = {1+ + Z~,m~) = (l.m") G V '. 

Thus 1+ G L- 1 . So C L ± . Similarly (L ± )~ C L^ . Hence (L x ) + + (L x )- C L x , which shows 

L is admissible. 
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Conversely assume L is admissible. From the above argument, L is admissible. But L = L, 
so L is admissible. □ 

Lemma 4.11. Let L\ be a self-dual lattice of V and L C L\ a sublattice of L\. Assume dimV = n. 
Then there exist a basis {ex, . . . , e„} of L\ and an integer s with < s < n such that 

{ex,..., e s ,w ts+1 e s+ i, m tn e n } 

is a basis of L, where t, > 1 for s + 1 < i < n. 

Proof. This is a part of Lemma in [MVWl p. 112]. □ 
This lemma implies 

Lemma 4.12. Assume V is such that V a — 0. Let L\ be a self-dual lattice of V and L C Li an 

admissible sublattice of L\. A ssume dim V = 2n. Then there exist a basis {ex, ... ,e„} of L\ , a basis 
{/i, . . . , f n } of Li and integers s + , s~ with < s + < n and < s~ < n such that 

{ei, . . . , e s +, m t "++ie s + + i, w tn e n } 

is a basis of L + , where U > 1 for s + + 1 < i < n, and 

{fl, • ■ • , f s -,^ jUs ' +1 fs-+i, ■ ■ ■ ,^ u "fn} 
is a basis of L~ , where U\ > 1 for s~ + 1 < i < n. 

Proof. By the above lemma, there exist a basis {«!,..., v 2rl } of L\ and an integer s such that 
{wi, . . . , v s , m t,+1 v s +\, . . . , ci7*"t;2ri} is a basis of L. Since L is admissible, each zu^vf (where U = if 
i < s) is in L+, and hence {u^ , . . . , v+ ,m ts+1 v~^ +1 , . . . , cc7*"u^} is a generator of the free O^-module 
L + . Then we can shrink it to a basis of L + . Similarly for L~ . □ 



5. Unramified dual pairs 

For i = 1,2, let (V,;, ( , }j) be an ei-Hermitian space over i? where G {±1}. If £162 = — 1 5 the 
space 

becomes a symplectic space of dimension dim^ Vi • dimj? V2 with the symplectic form defined by 

(v 1 ®v 2 ,v' 1 ®v' 2 ) = tr E/F ((v 1 ,v' 1 ) 1 (v 2 ,v' 2 } 2 ). 

We have the natural map U(Vi) x U(Vz) — > Sp(W), and say the pair (J7(Vi), U(V2)) is a dual pair. 

Assume both (Vi, ( , )i) and (V2, { , )a) admit self-dual lattices Li C Vi and i 2 C V2 with respect 
to the integers r\ and r2, respectively. We fix a decomposition 

H = V+ © Vf © V " 

as in Lemma T4. 2 1 Notice that the lattice 

A := Li ®o E l 2, 

viewed as an O- module, is a self-dual lattice of W = Vi V2 with respect to the integer fx + ^2. In 
what follows, let us assume V" = for either i = 1 or 2. 

We would like to choose our polarization W — W + © W~ for PF in such a way that A = A fl PF + © 
A n PF~. For this, we consider the following two cases: 
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Case 1 : V 2 = 0; In this case we choose 



so that 

A n W+ = Li © L+ 

An W~ = Li ®Lj ■ 

Certainly we have A = A n IV+ ®AnW~. 
Case 2 : Vf = 0; In this case we choose 

w+ = vt © v 2 
W~ = Vf © v 2 

so that 

A n W + = L+ © L 2 
4 n TV" = © L 2 . 

Certainly we have A = An W + ® An W~ . 

If V{ = Vf = 0, we can choose the polarization of W in either way. For this reason, let us make 
the following definition. 

Definition 5.1. For W — Vi © V2, «/ £/ie polarization is chosen as in Case 1 above, we call it "Type 
1 polarization" . If it is chosen as in Case 2, we call it "Type 2 polarization" . 

Remark 5.2. One important thing to be noted is that if W is given Type 1 polarization, the group 
U(Vi) is in the Siegel Levi (with respect to this polarization), and hence a g = for all g G U(V\). If 
W is given Type 2 polarization, f7(V 2 ) is in the Siegel Levi and a g = for all g G U(V 2 ). 

Remark 5.3. For a self-dual lattice A in W , if a polarization W = W + © W~ is so chosen that 
A = An W + ©An W~ , we say that the polarization of W is compatible with the self-dual lattice A. 
The above discussion shows that for our Vi and V 2 with fixed self-dual lattices L\ and L 2 , both types 
of polarization are compatible with the self-dual lattice L\ © L 2 . 

Each element w G Vi ©f V 2 can be viewed as an element in Horns (Vi, V 2 ) in the standard way as 
follows: For w — ^ v i ® v 2, define w : Vi — > V 2 by 

w ( v ) = ( v > v i)i v 2 
for v G Vi. Also w can be viewed as an element in Hom£j(V 2 , Vi) by 

for v G V 2 . Which one is meant is always clear from the context. 

We define P+ : W -)■ W+ C W to be the projection on W+ and P~ : W — > W~ C W the 
projection on W _ , so we have 

(3(w,w') = (P + (w),P-(w')), 
provided (3 is defined with respect to the polarization W — W + © W~ . Now for each i, define 
P^~ , P", P^ - : Vi — > Vi to be the projections on V 4 + , Vf and V~, respectively. If we view each element 
w G Vi ©f V 2 as w G Homs(Vi, V 2 ) then P + (w) and P~(w) as elements in Homs(Vi, V 2 ) are to be 
interpreted as follows. 



W+ = Vi © V 2 + 
TV" = Vi © V 2 " 
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• Type 1 polarization: Vf = 0; 

P + {w) = P+ o w 
P~(w) = P 2 W. 

• Type 2 polarization: Vf = 0; 

P + (w) =woP~ 
P~(w) = woP+. 

We often write w + := P + (w) and w~ — P~(w). Also for v £ Vi and we write v + := P^(v), 
vT := Pf(v) and v a :— P®(v). So for example, if w — v\ <E> v 2 £ Vi ® V 2 and W is given Type 
1 polarization, then w + = v\ ® v 2 and zz; - = «i ® w^" , and if it is given Type 2 polarization, then 

w + = (g) v 2 and w~ = v J" ® i> 2 . 

6. Two key lemmas 

In this section, we will formulate the two key lemmas which would imply the Howe duality conjecture 
for unramified dual pairs, if proven. They are the analogues of Theorem 1.4 and Proposition 1.5 in 
[MVW1 p. 103]. We closely follow the notations in |MVWj . 

As before, we fix (Vi, ( , )i) and (V2, ( , )2) together with self-dual lattices L\ and L2 with respect 
to r\ and T2, respectively, where r% + r 2 — r is the exponential conductor of if), and let 

W = Vi ® V 2 

be the symplectic space as before. We let 

A := L x ® L 2 C W, 

which is a self-dual lattice of W with respect to r. 

In this section, we do not assume anything specific about the polarization of W, and hence in 
particular, it might be neither Type 1 nor Type 2. For example if V" ^ and V 2 7^ 0, the polarization 
is neither of the two. But in this section, we include such cases in our consideration. We always 
realize the Weil representation of Sp(VF) in the lattice model with respect to A and the chosen 
polarization. As before, we denote the space of the lattice model by Sa or sometimes simply S. 

We let 

Ki = U(V t ) n T A 

K? = u(y i )nr A . 

Recall from Section[3]that T A = {g e Sp{W) : gA = A} and T° A = {g eT A : a g (a) 6 V r for all a £ A}. 
Note that if the residue characteristic is odd, we always have Ki — K° and it is the usual maximal 
open compact subgroup of U(Vi). Also if the polarization of W is chosen to be Type 1 (resp. Type 
2), then K\ = K\ (resp. K 2 = K 2 ) even when the residue characteristic is even. 
For any lattice L of V\ , we let 

B(L) = L 1 - ® 0e L 2 C W. 

One can check 

B(L) X = B(L ± ), 

where the _L for B(L) is with respect to r = r\ + r 2 and the one for L is with respect to r±. Also note 
that L C Li = Li C L^, and for each u £ U(Vi), we have (uL) 1 - = u(L x ). 
For each sublatticc L C Li, we define 

Ki(L)° := {u 6 KI : uL 1 - C L x }, 
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where we view K\ as a subgroup of Sp(W). Note that uL 1 - C L 1 - implies uL 1 - = L 1 - and the condition 
uL = L is equivalent to uL 1 - = L 1 - . Hence K\(L^)° = K\(L)° . 

One can check that the group Ki{L)° is an open compact subgroup of U(Vi). Of course Ki(Li)° = 
Kl 

Also define 

Ji(L) = {ue K\ (L)° : (u - 1)1^ C L} 

Hi(L) = {ue Ki(L)° : (u - 1)L X C 

Both of them are open compact subgroups of U(Vi) with Ji(L) C H\(L). In particular, we have 

-> Ji(L) -> ^i(L) -> Aut^/L); 

-> ffi(L) -> ifi(i) -> Aut(ii/L). 

Let us note that our J\{L) and H\{L) differ from the ones in |MVW) in that we always require each 
element u £ Ji(L) or H\{L) be in Ki(L)°, so that a u (a) G 7 :, ' r for all a E A, though for example if 
the polarization of W is Type 1, we always have a u (a) € 'P'', and hence our Ji(L) and Hi{L) coincide 
with those of |MVWj . 

For a sublattice M C L 2 , one defines open compact subgroups K2(M)°, Hz{M) and Jz{M) of 
t/(V2) analogously. 

We define 

5 i: ={/e^:supp/CB(i)} 

Also for any subgroup G C [/(Vi) which splits in the cover Sp(W), we define 

S G := {feS A : Lo^g) ■ / = / for all g g G}. 

Recall from (|3 .3[) that for each u; e M^, we have defined s w to be the unique function in Sa with 
supp(s lu ) = (A + w) x F such that s w (w, 0) = 1. Then the following is an easy exercise. 

Lemma 6.1. The space Sl is generated by s w where w G B(L). 

We have the following lemma, which is the analogue of part of Lemma in |MVW[ p. 102]. 

Lemma 6.2. Assume L is any sublattice if L\. For w G B{L) and h G Hi{L), we have the equality 

u)(h)s w — ?p(—(3(h~ 1 w — w,w) + a h (w))s w . 

In particular, the map 

tpf : h H4 ipi-Pih^w -w,w) + a h (w)) 

is a character on H\(L). 

Proof. By the above lemma, the space Sl is generated by the functions s w for w G B(L). Hence 
the first part implies the second part. To show the first part, let h G Hi(L). For w' G W, we 
have uj(h)s w (w' , z) = s w (h~ 1 w l , z + a h (w')), which is non-zero if (and only if) h~ 1 w l G A + w, i.e. 
w' G A + hw. Since h G Hi(L), we have hw — w G A, i.e. hw G A + w. So w' G A + w. Thus the 
suport of uj(h)s w is contained in that of s w . Hence uj(h)s w is proportional to s w . To determine the 
constant of proportionality, choose w' — w. Keeping in mind ft, _1 w — w G A, we have 

uj(h)s w (w, z) = s w (h~ 1 w, z + a h (w)) 

— s w (h^ 1 w — w + W, z + a h (w)) 

= ■>Jj(—f3(h~ 1 w — w,w) + a h (w))s w (w, z). 

Thus uj(h)s w = ip(—(5(h~ 1 w — w,w) + a h (w))s w . □ 
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We define 

Ji(L)°:= p| ker^ 

weB(L) 

Of course by definition of Ji(L)°, we have 
Proposition 6.3. For any sublattice L of L±, 

S L C S* Jl(L) ° 

Remark 6.4. the group J\{L)° is an open and compact subgroup ofU(Vi). To see this, the reader 
can verify that if the polarization of W is Type 1, Ji(L) = J\(L)° , and if the polarization of W is 
Type 2 and the lattice L is admissible, then J\(L)° = {u G J\{L) : a w (w) G V r for all w G B(L)}. 
Hence In either case, J\{L)° is an open compact subgroup ofU(Vi). (To show the latter case, use 
Lemma \3.10\ ) If W is of Type 2 but L is not admissible, one can always find an admissible lattice 
L' C L, and J\{L')° G Ji(L)° , which shows J\{L)° is open and compact. 

For a sublattice MCL 2 and w G B(M), we can analogously define ip™ and J2(M)°, and have 

Now let Hi (resp. H 2 ) be the Hecke algebra for U{Vi) (resp. U(V 2 )) as in |MVWj and u>(H 2 )S L 
the subspace of Sl generated by the elements of the form uj(tp)f for <p G H2 and / G Sl- The first of 
the two key lemmas for the proof of the Howe duality is 

Conjecture 6.5 (First Key Lemma). For any sublattice L C L\ we have 

lo(H 2 )S l = S J ^°. 

Also for each w G B(L), let 

M = M w = («;(ti7- ri Li) + L 2 ) ± - 

Then 

Apparently this is the analogue of Theorem in MVW ( p. 103]. But the inclusions lu('H2)Sl Q 
S j i( l )° and uj(Ui)S m Q 5 J2(M) ° immediately follow from the previous lemma because the actions of 
TLi and TL2 commute. The hard part is to show the other inclusion, which we do not know how to 
prove in full generality. 

If M is as in the above conjectural lemma, one can verify that w G B{M). With this said, let us 
state the second key lemma, which is the analogue of Proposition MVW, p. 103]. 

Conjecture 6.6 (Second Key Lemma). Let w,w' G B(L) be such that 

(1) w{vj-^L2) + Li = w'{vj^L 2 ) +L X = L ± ; 

(2) tpi = ?pi as characters on H\{L). 

Then there exists k G K\ such that A + w = k(A + w'). 

Let M = M w be as in the first key lemma, and w' G B(M) be such that 

(1) w'(w-^L 1 ) + L 2 = M ± ; 

(2) ^ = ip%' as characters on H 2 {M). 

Then there exists k G K 2 such that A + w = k(A + w'). 

Finally 

Theorem 6.7. The above two conjectural lemmas imply the Howe duality conjecture in the sense 
that for any irreducible admissible representation it ofU(Vi), if @^(tt) 7^ 0, then 0^(71") has a unique 
non-zero irreducible quotient. 
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Proof. If we believe the above two lemmas, one can simply trace the proof for the Howe duality con- 
jecture for odd residual characteristic as in [MVW| p. 103-106]. We give the details for this derivation 
in our special case where L is of the form L = vj L\ for k > 1 + e in a later section. □ 

7. A proof of a special case of the first key lemma 

In this section we prove the inclusion S Jl ^ C us(H.2)Sl and hence the first key lemma when V2 
is symplectic (and hence Vi is symmetric) and L C 2wL\. However we need this assumption only 
near the end of the section, and we do not even need to assume that one of V" and Vf is zero . Hence 
at the beginning, we do not make any assumption on Vi and V2 except, of course, that the pair is 
unramified. 

Our proof is a modification of the one given in [MVW1 Chapter 5.III]. Though we try to make 
our proof as self-contained as possible, the reader is aways advised to compare ours with the one in 
[MVWj . 

As in |MVW) . we always identify W with Hom(Vi, V2) or Hom(V2, Vi), and which one is meant is 
always clear from the context. Also we abbreviate 

J = Ji(L), J° = J X {L)°, H = H 1 (L), B = B(L), 

and the sublattice L C L\ will be fixed throughout. For w £ W, we define a function s[w] : Hp(W) —> 
Cby 

s[w](w',z) = / uj{u)s w (w' , z) du = I s w (u~ 1 w' , z + a u (w')) du. 
Jj° Jj° 

where (w',z) s Hp(W). (Recall from (|3.3[) that s w is the unique function in S whose support is 

(A + w) x F and s w (w,0) = 1.) 

Lemma 7.1. The function s[w] is in the space S J . 
Proof. To check s[w] £ S it suffices to show that 

s[w](a + w' , z) = ip(—P{a, w'))s[w](w' , z) 
for all a £ A and (w' , z) £ Hp(W). But 

s[w](a + w' , z) — I ui(u)s w (a + w' , z) du 

s w (u~ 1 a + u~ 1 w\ z + a u (a + «/)) du 
ip(-(3(u~ 1 a,u~ 1 w') + a u (a + w'))s w (u~ 1 w' , z) du 

^p(—(3(u'~ 1 a, u~ 1 w') + (3(u~ 1 a, u~ 1 w') — (3(a, w') + a u (a) + a u (w'))s w (u^ 1 w' , z) du 
%l)(—fi(a, w'))s u) (u _1 u'', z + a u (w')) du 



= ip(— f3(a, w 1 )) I oj(u)s w (w' , z) du 
J.j° 

= ^(-f3(a,w'))s[w}(w',z), 
where for the fourth equality we used 

a u (a + w') - a u {a) - a u (w') = j 8(« -1 o, u^w') - f3(a, w'), 
and for the fifth we used ifj(a u (a)) = 1. 
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Next we will show that s[w] G S J , namely u>(v)s[w] — s[w] for v G J°. But 
uj(v)s[w](w' , z) — s[w](v~ w' , z + a v (w')) 

oj(u)s w (v~ 1 w' , z + a v (w')) du 



Now one has 



because 



J° 

s w (u~ v~ w' , z + a v (w') + a v (v~ w')) du. 

J° 

a v {w') + a v {v- 1 w l )=a vv {w l ), 



a vu (w') = -OuuCu-^-V) 

= — u ■ a v (u v w') — a u (u v w') 
= — a v (v~ w') — a u (u~ v~ w') 
= a v (w') +a u {v- 1 w'). 

Hence the integral above is written as 

Swiu^v^w' , z + a vu (w')) du, 

J° 

which, by the change of variable vu t-> u, becomes 



s w (u w' ', z + a u (w')) du = I lo(u)s w (w' , z) du. 
J° J J° 

Hence oj(v)s[w] = s[w}. □ 
Let us note 

Lemma 7.2. s[w] ^ if and only if s[w](w, 0) ^ 0. 

Proof. Assume s[w] ^ 0, i.e. s[w](w' , z') ^ for some w 1 G W and z' G F. But if s[w](w' , z') ^ for 
some z' G F, then s[w](w',z) ^ for all z £ F. Then there exists u G J° such that (u~ 1 w',z) is in 
the support of s w , i.e. u~ 1 w' G A + w. Considering uA C A, we have w' G A + mo. So «/ = a + uw 
for some a G A. So s[to](a + mu,z) ^ 0. But we know s[w](a + uw,z) = ip(—/3(a,uw))s[w](uw,z) 
and ip(—/3(a,uw)) ^ 0, and hence s[w](uw,z) ^ 0. Let z = a u (w). Then s[w]( , ww,a u ('w)) = 
w(it -1 )s[io](u>,0) ^ 0. (See Remark O) But w(u -1 )s[W] = s[iu], and so sku](w,0) ^ . The 
converse is obvious. □ 

For each w G W, let 

C(u>) = (J u(A + w). 
ueJ° 

The union here is actually finite because of the compactness of J° . 
Lemma 7.3. If s[w] ^ ; the support of s[w] is C(w) x F. 

Proof. If (w' , z) is in the support of s[w], then the integrand in s[iu](u/, z) is non-zero for some u G J°, 
and hence u~ 1 w' £ A + w, which implies («/, z) G C(w) x F. 
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Now we will show that for any element (w 1 , z) £ C(w), s[w](w', z) ^ 0. We may assume z = 0, and 
assume w' = a + uw for some a £ A, considering uA C A. But then 

s[w]{w' , z) — s[w](a + uw, 0) 

= ip(—/3(a, uw))s[w](uw, 0) 

= ip(—P(a, uw) - a u (w))s[w](uw, a u (w)) 

— tl)(—/3(a, uw) — a u (w))uj(u~ 1 )s[w](w, 0) 

= i/)(—0(a,uw) - a u (w))s[w](w, 0), 

and by the above lemma s[w](w,0) ^ 0. □ 

If s[w] ^ 0, then it is a unique (up to constant) function in S J with support equal to C(w) x F, 
because if s £ S J has support equal to C(w) x F, its values are determined by the value at (w, 0). 
Also we have 

Lemma 7.4. The space S J is generated by the functions of the form s[w]. 

Proof. Let s £ S J ° , and C x F C W x F its support. Then C is a finite disjoint union of the sets 
of the form A + w for some w £ W. But since s £ S J , we have itC = C for all u £ J°. Hence if 
A + w C C, then it(A + u>) C C for all u £ J°. Hence C is written as a finite disjoint union of the 
sets of the form C(w). Hence s must be a linear combination of functions whose supports are of the 
form C(w) x F. The lemma follows. □ 

We need to be more specific about when the function s[w] is nonzero. First since the support of s w 
is A + w, the integrand of the integral defining s[w] is zero unless u~ 1 w' £ A + w, and hence we have 

s[w](w' , z) = / uj(u)s w (w' , z) du. 



But as we mentioned above, the suport of s[w] is C(w) x F, and hence we may assume w' £ u (A + w) 
for some u' £ J° . Hence the above integral is over the set 

{u £ J° : u^ 1 u'(A + w) = A + w}. 

But one can see 

{u £ J° : u~ 1 u'(A + w) = A + w} = {u £ J° : u(A + w) = A + w} 
via the map u i— > u^ 1 ^ . Now define a sublattice L w C L\ by 

Li =L l +w{m~ r2 L 2 ). 

Then w £ B(L W ) and the stabilizer in K\ of A + w is Hi(L w ). Hence the integral for s[w](w', z) is 
over J° fl Hi(L w ) and by Lemma 16721 we have 

s[w](w',z)= J il>{—(3(u~ 1 w — w,w) + a u (w))s w (w' , z) du. 
«eJ°ni?i(i TO ) 

Note that the map u M> ijj(—f3(u~ 1 w — w,w) + a u (w)) is a character on H\(L W ). Hence by the 
orthogonality of characters, we have 

Proposition 7.5. For each w £ W , 

s[w] ^ if and only if 4)(—(3(u~ 1 w — w 7 w)+a u (w)) = l 

for all u £ J° such that u(A + w) = A + w. (Here the condition u(A + w) — A + w is equivalent to 
uw £ A + w.) 
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An in [M VW] , we would like to write the condition ip(—f3(u~ 1 w — w,w) + a u (w)) = 1 in a more 
explicit form by using Cayley transforms, whose notion we will recall now. For an e-Hermitian space 
(V, ( , )) over E, we let u(V) be the Lie algebra of U(V), namely 

u(V) = {ce End(V) : (cv, v') + (v, cv') = 0}. 

There is a bijection 

{c G u(V) : 1 + c is invertible} U(V) : 1 + g is invertible} 

where the bijection is given by 

g=(l-c)(l + c)-\ c=(l-g)(l + g)-\ 

We call (1 — c)(l + c)^ 1 the Cayley transform of c. For x, y £ V, define c XtV £ Ends(V) by 

c x, v (v) = (v,y)x - e(v,x)y. 

One can check that c x , y 6 u(V). Assume 1 + c XyV is invertible. We let u x , y be the Cayley transform 
of c Xj y, namely 

^x : y — (1 C x ^ y )(\ -\- C x ,y) 



Now let x,y £ Vi be given. We would like to know when (1 + c^) -1 and hence the Cayley 
transform exist, and if it does exist when it is in the group H or J For this purpose we need to 
introduce the notion of order with respect to a lattice. Namely for an e-Hermitian space (V, ( , )) 
over E and a lattice M C V, we define "M-order" or Am : V — > Z by 

ordA/(v) = max{m eZ:u£ -cu m M}, 

i.e. v £ w m M\w m+1 M . Namely if we choose an Oe basis {v\, . . . , v n } of M and write v — a\V\ + 
• • • + a n v n , then ordM(w) = min{ord£;(ai)}. (We assume ordM(O) = oo.) Apparently ordjf (x + y) > 
minjordA/ (x) , ord M (y) } ■ 

Next we need to go back to the dual pair situation where L is a sublattice of our self-dual lattice 
L 1 C Vi and W = V x ® V 2 . 

Proposition 7.6. for cc, y £ Vi and w £ W , consider the following conditions: 

(i) ord Ll (a;) + ord Ll (y) > 1 - n; 
(ii) oid L (x) + ordi(y) > -ri - e; 

fiiij ordi(a;) + ordL 1 (y) > —r\ — e and ordr^ (x) + ordi(j/) > — ri — e; 
ordi 1 (a;) +ordi 2 (wt/) > — e anrf ordi 2 (?«a;) -l-ordL^j/) > — e. 

Depending on which of those conditions the pair (x, y) satisfies, the Cayley transform U x>y satisfies 
the following: 

(1) The condition (i) implies u XtV exists and u XlV Li C L\; 

(2) The conditions (i) and (ii) imply (u x . y — 1)L Q L, and hence if the condition ip(a U:c y (a)) = 1 
for all a £ A is satisfied, we have u XtV £ J ; 

(3) The conditions (i) and (Hi) imply (u X:V — 1)L C L\, and hence if the condition ip(a U:c y (a)) — 1 
for all a £ A is satisfied, we have u XtV £ H; 

(4) The conditions (i) and (iv) imply u x ^ y w £ A + w. 
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Proof. (1) Assume the condition (i) is satisfied. Let r x — ord^^x) and r y = ordL 2 (y), and so 
r x + r y > 1 — n. Then for I E L\, we have 

= zu r * +Ty (l,xu~ ry y) 1 TU~ rx x - e 1 G7 rx+r! '(/,n7 _rx a;) 1 ci7 _r! '2/, 

where both (l,zu~ ry y) 1 'cu~ rx x and (l,w~ T ' x x) 1 w~ T ' y y are in ra7 ri Li. Hence c Xj!/ (Z) E nj^+^+^ii C 
•cuLi. Hence c x . y (Li) E roLi and 1 + c Xi!/ is invertible. (To see 1 + c Xi!/ is invertible, notice that for 
any nonzero v E Vi, we have ord.^ (c Xiy (v)) > ordi 1 (w) and so (1 + c Xi!/ )(w) ^ 0.) 
Let 

Notice that since c Xjy (Li) G wL\, if we set the topology of V to be induced from that of E, the 
sequence c™ y (v) converges to as n — >• oo, and thus we obtain the geometric series 

oo 
n=0 

which gives 

(7-7) = (1 - 0(1 + ^.j/)" 1 = 1 - 2c -^ + 2c L - 2c L + • • • • 

Hence one can see u XtV L\ C Lj. 

(2) Assume the conditions (i) and (ii). From the above series expansion of u XiV , one can tell that 
to show (u Xty — 1)L C L it suffices to show 2c XlJ/ L _L C L. Let r x = ordL(x) and r y = ordL(y), and 
so r x + r y > — ri and both ?i7 _rx x and m~ T ' y are in i . Then for I E L , we have 

2c X; j / (Z) = 2((l,y) 1 x - e 1 (l,x) 1 y) 

= 2(m Tx+ry {l,w~ ry y) 1 w~ rx x - e 1 Tu rx+ry {l,w~ Tx x) l w~ ry y), 

where both (I, zu~ Ty y) 1 m~ r:c x and {l,m~ r: *x) 1 m~ ry y are in w Tl L. Hence 2c XiV (l) E w r,c+ry+ri+e L. 
So if + r y > — n — e, we have 2c x ^ y (l) £ L. 

(3) This case is completely analogous to (2). 

(4) Finally assume exists and the condition (iv) is satisfied. We need to show (u x _ y — l)w E A. 
Again by the series expansion of u x ^ y , it suffices to show 2c XiV (w) E A. Note that here we are viewing 
c XtV as an operator on W rather than just on Vi in the obvious way. Also we may assume w = v\ <g> v 2 
where v\ E V\ and u 2 E Vi. Then 

2c XiV (w) = 2((ui,j/) 1 a; <E>v 2 - e^vi.x)^ ® u 2 ) 

= 2x® {vwy)^ - 2eiy® (wi,x) 1 w 2 . 

Note that ordL 2 ((ui,y) 1 W2) = ordL 2 (wy) and ord_L 2 ((ui, x) 1 u 2 ) = ordi 2 (wx). Then arguing as above, 
one can see that the condition ord^x) + ord^wy) > — e implies 2x <S> wy E A and the condition 
ord^ 2 (wx) + ordi 1 (y) > —e implies 2y <g> £ A □ 

The following special case will be also needed. 

Proposition 7.8. Assume e\ = —1. Let x, y E Vi &e swc/i i/iai x = ay for a E E with a — a. Also let 
w E W. Consider the following conditions: 

(i) ord Ll (x) + ord Ll (y) > 1 - ri - e; 
(ii) ord L (x) + ord L (y) > -n - 2e; 

(Hi) ordi(x) +ordi 1 (y) > — ri — 2e and ord^^x) +ordi(y) > — ri — 2e; 
fivj ordi^x) +ordL 2 (w2/) > — 2e and ordi 2 (wx) +ordz, 1 (y) > — 2e. 

Depending on which of those conditions the pair (x, y) satisfies, the Cayley transform u x _ y satisfies 
the following: 
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(1) The condition (i) implies u XtV exists and u x . y L\ C L\; 

(2) The conditions (i) and (ii) imply (u x<y — 1)^ C L, and hence if the condition tp(ot U;c „(<x)) = 1 
for all a G A is satisfied, we have u xy G J; 

(3) The conditions (i) and (Hi) imply (u XiV — 1)L Q L\, and hence if the condition ip(a Ulc y ( a )) = 1 
for all a G A is satisfied, we have u Xt y G H; 

(4) The conditions (i) and (iv) imply u XjV w G A + w. 

Proof. The proof is the same as the one for the previous proposition, except that this time we have 
c x , y {v) = 2{v,x) 1 y for v G Vi. □ 



Lemma 7.9. Let x,y G Vi satisfy the conditions (i) and (iv) of Proposition [7751 or Proposition \ 7. 8\ if 
x = ay with a = a. Then 

P(u x y w — w,w) = 2f3(c Xt y(w), w) mod AV r . 
Proof. For notational convenience, let u = u XiV and iv' = (1 — c Xyy )~ l w. Then we have 
f3(u~ 1 w — w,w) — (3(u~ 1 w, w) — (3(w, w) 

= f3((l + c x , y )w', (1 - c x>y )w') - (3(w, w) 
= /3((1 - c x , y + 2c X:V )w', (1 - c Xt y)w') - [3(w, w) 
= /3((1 - c x , y )w', (1 - c XtV )w') + 2(3(c Xi yw', (l - c XtV )w') - j3(w, w) 
= f3(w, w) + 2[3(c XiV w', w') - 2f3(c Xi yw', c XiV w') - f3(w, w) 
= 2f3(c Xiy w', w') - 2f3(c XtV w', c XtV w'). 
Now by writing w' = (1 — c x , y )~ 1 w in terms of geometric series as in (|7.7j) . one can see that 
2[3(c x , y w', w') - 2/3(c Xt yw' \c XtV w') = 2f3(c x , y w,w) + (higher terms), 

where (higher terms) is the sum of the terms of the form A(3(c^yW,c x y w) for k > 1 and I > 1. Since 
(x,y) satisfies the condition (iv), c XyV w G A. Hence those higher terms are in V r , which proves the 
lemma. □ 

Now we can write f3(c Xi y(w),uu) more concretely in terms of (— , —) 2 as long as the polarization of 
W is chosen to be either Type 1 or Type 2. Accordingly, from now on we will assume either Vf = 
or V% = 0, and if the former is the case, we assume the polarization is Type 2 and the latter Type 1. 
If both X>i and Vf are zero, the polarization can be take to be either Type 1 or Type 2. 

Lemma 7.10. f3(c Xiy (w),w) can be computed as follows: 
Type 1 (V% = 0) : 

f3(c x>y (w),w) = - tr E/F ((w(x), w(y)) 2 ) . 

Type 2 (V? = 0) : 

P(c x , y (w),w) = -tt E /F ((w(x + ),w(y)) 2 + (w(x),w(y + )) 2 ) . 
Proof. Let w = J2i v i,i ® v 2,i, where Vij G Vi and V2,i G V2. Then 

Cx,y(w) = ^ C Xt y(Vl ti ) ® V 2 ,i 
i 
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and hence 

f3(c x ,y(w),w) = f3(^2((v ltl ,y) 1 x - e 1 (v ltl ,x) 1 y) <g) v 2 ,i, ^ vij ®v 2 . 3 ) 

i 3 
= Y1^1 P{{{ v hi'V)l X ~ £ 1 X )lV) ® V 2A, V hj <g> V 2 ,j). 



Here 

=(3{{vi,i,y) l x®v 2 ,i,vi, j (Z>v 2 ,j) - ei/3((wi, i ,x) 1 y ® v 2 , ll v 1 . j ®v 2<j ). 
Now we have to argue case-by-case. 

Type 1 (V 2 a = 0) : Recall W+ = Vi V 2 + and W~ = Vi <8> V 2 ~~. Then 

Pdvij^)^® v 2 ,i,v 1J ®v 2J ) - ei/3((wi^,x) 1 y(g)w 2jl ,w 1 j ®v 2j ). 
= - ^e/f {-((vi,i, y) x x, vx^^v^i, v 2J ) 2 + e 2 ((vi, i ,x) 1 y, vij}^^, u^) 2 ) 

= - Ize/f ((favij)^, (y,v hl ) 1 v+ l ) 2 + (favij)^, (»,Wlj)i«^-> 2 ) 

= - tT B /F («iB,Wlj>iW2j. (»."l,i>l"2;i>2 + (( x > v l,i)l v t,i, (V W U> 1«2J> 2 ) ■ 



Hence 



* i 



» J 



\ j » » j 

= - trjs/ir ((w(x)",-u;(y) + ) 2 + (w(a;) + , w(y)~) 2 ) 
= -tr E/F ({w(x),w(y)) 2 ) 

Type 2 (Vf = 0) : Recall W+ = V x + ® V 2 and W" = Vf ® V 2 . Then 

Piivi^iy)^ ® v 2 ^,vij ®V2,j) - eiP((vi,i,x) 1 y®v 2ii ,vij ®v 2 j) 
= - tr £/i r ^((wi.i,^!^,^)^^^,^^^ + £i((wi, l ,a;) 1 ?; + ,w l ; j ) l (w 2 , i ,w 2j -} 2 

= - tr S/i r ((j/,Ul,i) 1 (a; + ,U t r,-> 1 <U2,j,«2,i>2 + 'yi,i}i<J/ + , ^l^j)!^^, ^2,j) 2 ) 
= - tXE/F (((^ + ^l" J ) 1 «2,j, (|/,Wl,i> 1 «2,i> 2 + ((E.Vl.i)!^, (»+, ^"^^J 

= -tr £/i r (((x + ,vl j ) i v 2 , J ,(y,v 1 , i ) 1 v 2 , i ) 2 + {(x, wi^t^i, (y+, v^)^)^ . 
Hence by taking J2i J2j as above, one obtains the desired formula. 
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Next we would like to know when we have a u (w) £ V for all w £ B when u is a Cayley transform. 
Let us start with 

Lemma 7.11. Let w £ W be any. 

(1) Suppose W is equipped with Type 1 polarization. Assume u x ^ y exists for x, y £ V\ . Then 

a u *.y(w) = 0. 

(2) Suppose W is equipped with Type 2 polarization. Assume u x ,y exists where x, y £ ■ Then 

!{c X: y(w-),w-) = -2tT E / F ((w(x),w(y)) 2 ) ifx,y€ ; 
(w+,c X! y(w + )) = 2tv E / F ((w(x),w(y)) 2 ) ifx,yeV^; 
otherwise. 

Proof. (1) This case is obvious because, if W is given Type 1 polarization, then a g = for any 
geU(Vi). 

(2) First assume x £ and y £ V 1 (or x G V 1 and y £ V^). Then one can see that u x , y is in the 
Siegel Levi of Sp(W) and hence q"''» = 0. 

Next assume x,y £ VJ 1 ", and for notational simplicity, let us write u — u X:V . Viewed as a operator 
on W, c x , y \w+ — and the image of c x ^ y is in W + . Hence c x y — and c XtV may be viewed as a map 
from W~ to W~ . Then one can see 

1 -2c x . y \ x (1 2c x>y 

1 J V° 1 

where the matrix is chosen with respect to the polarization W — W + + W~. Now for w = w + +w~ £ 
W, 

a u (w) = -a u (u~ 1 (w + +w~)) 

= -a u (w + + 2c XtV (w~) + w~) 
1 

~ ~2 

= (c X ,y(w~),W~) 



2c x , y {w ),w~) by (gU 



Let us write w = ® v 2 ^. Since the polarization is Type 2, we have w = v x i ® v 2 .i- Thus 



Here 



{Cx,y{v 1:i ®V2,j),V lti ®V 2 ,j) 

= tr E/F ^(c x , y (vx !i ),Vx ij ) 1 (v 2 ,i,V2,j) 2 ^ 

= ^e/f [(((vi,i,y) 1 x-e 1 {vx ti ,x) i y),v^ j ) i (v 2 ,i,v 2 j}^ 

= tr E/F ((vl l ,y) 1 (x,vl J ) i (v2, t ,v 2 , J ) 2 ~e 1 (vl i ,x) i {y,vl J ) 1 {v 2 ^,V2j) 2 ') 



■tr, 
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Now by taking . > one can see that 



(c x , y (w~),w~) = tr E /F [e 1 (w-(y),w-(x)) 2 - (w~ (x),w~ (y)) 2 ) 

= - toE/F {(w^(x),w-{y)) 2 + (w~(x),w~(y)) 2 ) 

= -2tr E/F ((w~(x),w-(y)) 2 y 

Now since x, y £ , we have w~ (x) — w(x) and w~(y) — w(y). Thus the lemma follows. 
The case x, y 6 Vjf is almost identical. 



□ 



This lemma immediately implies 

Lemma 7.12. Let weB and x, y G Vi- Assume u XtV exits. 

(1) Assume that W is given Type 1 polarization. Then a Ul - y (w) G V r ; 

(2) Assume that W is given Type 2 polarization and x,y G and L is admissible. Assume 
further that, if x,y G Vy or x,y G V-f , then the condition (ii) of Proposition |775| is satisfied. 
Then a u -*(w) G V r . 

Proof. (1) is obvious. For (2), the only case that is not too obvious is when x,y G or x, y G V-f . 
Assume x, y G Vy. If the condition (ii) is satisfied, we have c XtV w~ G L <g) L 2 . (Note that since L 
is admissible, if w G B then w _ G -B.) Hence a Um - v (w) — (c x>y (w~),w~) G V r . The proof for case 
x, y € Vf is essentially the same. □ 

One consequence of the lemma, especially for Type 2 polarization, is the following. 

Proposition 7.13. Let x,y G Vi &e smc/i that the pair (x,y) satisfies (i) and (ii) of Proposition \776\ 

(1) IfWis given Type 1 polarization, then u x<y G J° . 

(2) If W is given Type 2 polarization and L is admissible, then u XiV G J° as long as x,y G V^. 

Proof. We prove only (2). Let u = u x _ y . Assume W is given Type 2 polarization. By the above 
lemma, u G J° if and only if f3(u~ 1 w — w,w) G V r for all w G B. But this happens if and only if 
u~ 1 w — w G L®L 2 for all w G B, because L is admissible. Hence the proposition follows by Proposition 
17.61 (2). (The reader should notice that this does not necessarily follow if L is not admissible.) □ 

We should mention that if W is given Type 1 polarization, we actually have J° = J. 

For w G W and t E Z with t > 0, let us define the condition (wt) as follows: 
(wt) w^ ri w(2vjL 1 n L) C vj~ t L 2 . 



Let us note that Sq C Si C S*2 C • • • , and 5 = Ut>o ^ ne s P ace & is stable under the action of 
J° because J° preserves the space 2wLi n L. Hence we have 



t>o 

One can also check that if w G W satisfies the condition (wt) , then w G S/ . 
In what follows, we will show 

Proposition 7.14. Assume V2 is symplectic (if the residue characteristic of F is even), and L is 
admissible if the polarization ofW is Type 2. (If the polarization ofW is Type 1, L does not have to 
be admissible.) We have the inclusion S J C lo(TL2)Sq . 



We define 



S t ■= {s G S : (wt) holds for all (w, 0) G supp(s)}. 
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Before going into the proof, let us mention that this immediately implies 

Proposition 7.15. Under the assumption of the previous proposition, if L C 2wh\, we have the 
equality 

S J ° =lu(H 2 )S l , 

which is nothing but the first key lemma. 

Proof. If L C 2wLx, then S Q = S L . □ 

To prove Proposition l7.141 recall from Proposition [673] that for each w G W we have shown s[w] ^ 
if and only if ip(—f3(u~' 1 w — w,w) + a u (w)) — 1 for all u G J° such that u~ 1 w G A + w. 

Lemma 7.16. Let w G W be such that s[w] ^ 0. Also let x, y G V\. Further assume x, y G and L 
is admissible in case W is given Type 2 polarization. Then if the pair (x, y) satisfies (i), (ii) and (iv) 
of Proposition \7.6\ Then 

2{w(x),w(y)) 2 eV r E . 
(Here V2 does not have to be symplectic.) 

Proof. Recall that if the pair (x,y) satisfies (i), (ii) and (iv) of Proposition 17. 6( then u X:V G J°. 
Assume W is given Type 1 polarization. By Lemmas 17.91 and 17.101 one has 

V>(2tr B/F (w(x),w(y)) 2 ) = 1. 

By replacing (x,y) by (ax,x) for any a G O^, we still have the same, namely 

ip(2tr E/F (w(ax),w(y)) 2 ) = ip(2 ti E/F a(w(x), w(y)) 2 ) = 1 for all a G O e , 

which implies 

2(w(x),w(y)) 2 G V T E . 
Assume W is given Type 2 polarization. Note that 

(w(x) 7 w(y)) 2 = (w(x+),w(y + )) 2 + (w(x~),w(y~)} 2 + (w(x+) 7 w(y-)) 2 + (w(x~),w(y + )) 2 , 

and so it suffices to show that 2 times each of those terms is in V r E . 

First consider the pair (x + ,y~). Since L is admissible, the pair (x + , y~) also satisfies the conditions 
(i), (ii) and (iv) of Proposition 17.61 By Lemma [7. 121 we know a 11 ^^^ = 0. Thus by Lemmas 17.91 and 
17.101 one has 

ip(2tr E/F (w(x + ),w(y~)) 2 ) = 1. 
Arguing as in the previous case, this implies 

2(w(x+),w(y-)) 2 eP r E . 

The case for (x~,y + ) is the same. 

Next consider the pair (x + ,y + ). By Lemma T7. 121 we know u x + y + G J° . By Lemma [7.111 together 
with Lemmas 17.91 and 17.101 we conclude that 

^(-^(u^w - w,w) +a u (w)) = ip(4tr E/F (w(x + ),w(y + )) 2 -2tr E/F (w(x + ),w(y + )) 2 ) 

= rJj(2tT E/F {w(x + ),w(y+)) 2 ) 

= 1. 

Arguing as before, this implies 

2{w(x+),w(y+)) 2 eV E . 

The case for (x~,y~) is essentially the same. □ 
Using this lemma, we have 
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Lemma 7.17. Let t > be fixed, and let w G W be such that s[w] =/= and s[w] G 5/ , so w satisfies 
the condition (wt). Assume x,y G 2wL\ PI L and assume further that x,y G Vj^ and L is admissible 
if W is given Type 2 polarization. Then we have 

(m t -^w(x),zu t -^w(y)) 2 G C Pp+ 2 . 

(Again V 2 does not have to be symplectic.) 

Proof. First notice that the pair ( 2 --cu t ~ 1 ~ Tl x, y) satisfies the conditions (i), (ii) and (iv). So by the 
above lemma, we have 2(w{±zu t ~ 1 - ri x),w(y)) 2 G V r B , which gives 

(vj t ^w(x) 1 vo t ^w(y)) 2 eV r i +t+ \ 
where recall r = r\ + r 2 ■ The case for Type 2 polarization can be proven in the same way. □ 

Now we are ready to prove Proposition 17.141 Though our proof is almost identical to the one given 
in |MVWi p. 11 8- 11 9], we give details here for the sake of completeness. 

Proof of Proposition \7.14\ We only give a proof for the case of Type 2 polarization, leaving the Type 
1 case to the reader. Hence for what follows, L is admissible. 

Since we have S J = Ut>o > ^ suffices to show 5/ C u(TL2)Sf_ 1 for t > 1. From Lemma [7.41 
we know that the functions of the form s[w] where w satisfies (wt), i.e. w~ Tl w(2wLi n L) C w L2, 
generate the space Hence we have to show that for such s[w], there exists u G ?7(V 2 ) such that 
uj(u)s[w\ G St— 1, where u is some metaplectic preimage of u. (Note that if uj{u)s\w] G St-i, then 
u)(u)s[w] G due to the commutativity of the actions of U(Vi) and J7(V 2 ).) 

Let X be the image of va t ~ Tl w(2wL\ n L) in LzjwLi. Let £1, . . . , x s G 2cciLi H L be such that the 
reductions of raj 4-1 " 1 ly(xi), . . . , zu t ~ ri w(x s ) in L2/WL2 form a basis of X. (Here we may assume each 
Xi is in (2voL\ PlZ) for the following reason: If the reductions of w t ~ Tl w(xi), . . . , vj t ~ ri w(x s ) form a 
basis of X, then the reductions of tn t_ri w(xf ), . . . , 7Z7 t_ri u>(x+), ■cc7 t ~ ri w(xj~), . . . , w t ~ Tl w(x~) span 
X, and hence can be reduced to a basis. Moreover since L and L\ are admissible, G 2vjL\ n L.) 
Now by the above lemma applied to the pair [xj, ,Xj), we have 

(zu t - ri w(x t ),vo t - ri w{x J )) 2 G 7>£ +t+1 C V r E 2+2 

for all i, j G {1, . . . , s}. Hence by Lemma |4"7TI there exist elements e\,...,e s G L 2 and subspaces X, V| 
and Y" of V2 such that 

• v 2 = x © v 2 ° © y ; 

• {ei, . . . , e s } is a basis of X; 

• X and y are totally isotropic; 

• X + Y is orthogonal to V2 ; 

• L 2 = L x © L° 2 © Ly , where L x = -X" H L 2 , £3 = V| n L 2 and L Y = Y n L 2 ; 

• ej = zu t ~ ri w(xi) mod n7* +1 L 2 for i € {1, ... , r}. 

Let x G (2737L2 fl £) ■ Since L and Li are admissible, cc G 2wLi n £. Let us write 

ro*~ ri w(x) = + V° + V Y G Xx © L 2 © Ly, 

where vx G Lx,v° G £2 an d ^y G Ly. Since the reduction of m t ~ ri w(xi) is in X, the reductions of 
v° and iy are zero, and in particular vy G vjL%. For each i G {1, . . . , r} we have 

(ei,vy) 2 — {ei,m t ~ ri w(x)) 2 by the decomposition L 2 = Lx ® L 2 © iy 



: :~ ' 1 w(x i ) + vj t+1 l, vj 1 ri w(x)) 2 for some I G L 2 



7 t - ri w(x i )+w t+1 l,w t - 
(w t ~ ri w{x t ),m t -^w{x)) 2 mod p£+ t+1 



mod •p^ 2+t+1 by the above lemma applied to the pair (xi,x). 
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Since {ei, . . . , e s } is a basis of Lx and Ly — Homo s (Lx,V^) via the map y i— > (—,y) 2 , we obtain 
vy G n7 t+1 Ly. Therefore 

n7 t_ri w(2a7L 1 flL)CL x ® wL° 2 © n7 t+1 L y . 

Now let to' G C(w), so we may assume to' = mo + a for some a G A and u£ J°. Then 

w*- ri u?'(2ro£i ni) = tn*- ri (ikc + a) (2n7Lx n L) 

= zu*~ ri (mw^tuLi nl) + a(2a7ii n Ln 

= vo l - ri (w(vT x (2vdL x n L)) + a(2n7Li n L)j 

CLiffi n7^2 © n7 t+1 Ly + 2zu t+1 L 2 
C L x fficcL^ ffiro t+1 Zy. 

Let us define the operator u G J7(V 2 ) by 

u = roldx ©Id v ° ffitn -1 Idy-, 

where Idx,Idv° and Idy are the identity operators on the corresponding spaces. (It is clear that u 
is indeed in [/(V 2 ).) Fix a preimage u of u in t/(V 2 ). Define s :— u>(u)s[w] G w([/(V 2 ))St. We will 
show s G St-i, which will imply s[w] = lo(u~ 1 )s G u){%2)S^2.\, and will complete the proof. For this, 
it suffices to show that for all w' G W such that s(«/, 0) ^ we have m~ ri w'(2wLi nL) C ■cu t ~ 1 L 2 - 
Now from (|3.4|) one can see that s(w',0) is (a scalar multiple of) 



M u o s[w](w' ,0) = / ip{P(a, w'))s[w](u' 1 (a + w'),a u (a + w')) da. 
Ja/a u 

Hence in order for this integral to be non-zero, we must have 

u^ 1 (a + w') G C(w) for some a G A. 
But if u~ l (a + w') € C(w) as we have shown above, we have 

n7 t " ri u" 1 (a + w'){2vjL x DL) C L x ® vjL° 2 © m t+1 L Y . 
By multiplying u to both sides, one obtains 

m t ^ ri (a + w')(2mL 1 n L) C roL x © roL t ° +1 © tuLy = n7L 2 , 

which implies 

m t ^ ri w'{2vjL 1 nl)C n7L 2 

because m t ~ Tl a(2vj L\ fl L) C n7L 2 . This gives ro -1 " 1 w'(2tnLi fll) C a7 t_1 L 2 - The proposition is 
proven. □ 

As in Proposition [7T5l if L C 2wL\, Proposition 1 7 . 1 41 implies the desired equality S J ° = uj(%2)Sl- 



Now, unfortunately it seems that (if the residue characteristic is even) we cannot proceed further 
than this simply by following the arguments in [MVW to show S J ° = cj(% 2 )Sl if L % 2zuL\ for 
several reasons. For example, the analogue of Lemma II. 7 in MVW] p. 112] cannot be shown for the 
case of even residual characteristic. 
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8. A proof of a special case of the second key lemma 

In this section, we will give a proof of the second key lemma to the extend necessary to prove our 
main theorem. Let us start with a couple of lemmas: 

Lemma 8.1. Let L C L\ be a lattice. For w G B(L), w(vj~ r ' 2 L 2 ) + Li ^ L if and only if there 
exists a lattice L' such that L C L' C Li and w G B(L'). 

Proof. Assume w(w~ T2 L 2 ) +L\ ^ L x . Note that it is always true that w(vj~ r2 L 2 ) + L\ C L x . Hence 
we assume w(m~ r ' 2 L 2 ) + L\ C L^. Then we can take L' to be such that 

L r± = w{m- r2 L 2 )+L u 

so L' C , which implies L C L'. But one can see w G B(L'). 

Conversely, assume there exists a lattice V such that L C V C L\ and w G B(L'). Then L' C L , 
which implies w(vj~ r2 L 2 ) + L\ C L' C L- 1 -. □ 

Lemma 8.2. For a lattice L C L\ and w G B(L), w(vj~ r ' 2 L 2 ) + L\ = L if and only ifw~ 1 (w ri L 2 ) n 
Li = L, where w~ 1 (w ri L 2 ) is the inverse image of w ri L 2 when w is viewed as a map w : Vi — > V 2 . 

Proof. Assume w(w~ T2 L 2 ) + L\ = L . If {ei} i is a basis of L 2 , then we can write w = m, g) e^, 
where to; G L x . We then see that 

w{vj~ r2 L 2 ) + L\ = span {mj, + Zi = L . 

Now let I G w~ 1 (nj ri L2) H Li. So = (IjUii)^ G m ri L 2 , which means (l : mi) 1 G 'P^ 1 for all 
i. Thus for any x G span{mi} i + Li = L , we have {l,x) 1 G V r ^ , which implies Z G L. The other 
inclusion L C u> _1 (c;7 , ' 1 L2) H Li is clear because w G B{L). 

Conversely, assume w~ 1 (vu Tl L 2 )nLi = L. But assume w(w~ V2 L 2 )+Li ^ L 1 - . By the above lemma, 
there exists a lattice L' such that L C L' and u; G B(L'), which implies L' C w~ 1 (vj ri L 2 ) n Li, and 
hence 1/ C w -1 (vj ri L2) H L\, which is a contradiction. □ 

Now we specialize to the orthogonal-symplectic dual pair. 

Proposition 8.3. Assume the pair (Vi, (— , — )i) and (V 2l (— , — )2) is such that V 2 is symplectic. We 
let dim Vi = m and dim V 2 = 2n. We give W = V\ ® V 2 Type 1 polarization, i.e. W + = V\ ® V 2 and 
W~ — Vi £5 V 2 . Assume L is a sublattice of L\ which admits a basis of the form 

{ei, . . . , e s , zu ts+1 e s+ i, . . . , w tm e m } 

for some s G {0, . . . , m — 1}, where {ei, . . . , e m } is a basis of L\ and ti > 1+e for all i G {r+1, ■ • ■ , rn}. 
Let w G B(L) be such that w(m~ r ' 2 L 2 ) + L\ = L . Let w' G B{L) be such that 

• w'{vj- T2 L 2 ) + L 1 = w(w- r2 L 2 ) +Li = L x ; 

• ip™ = ip™ as characters of Hi(L). 

Then there exists k G K 2 such that A + w = k(A + w'). 

Proof. Though this can be proven simply by modifying the proof of Proposition 1.5 of |MVW| p. 124- 
125], we will give the details. 

First note that for each i G {1, . . . , s}, we have w{ei), w 1 (ei) G L 2 . Hence by adding some elements 
in Atow and w' , respectively, one can assume w{ei) — w'(ei) = for all i G {1, . . . , r}. Also of course 
we may assume ti < tj for i < j. Let 

Zi = w(m ti ~ ri ei) and z[ — w' (vj ti ~ ri ei) 
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for each i G {s + 1, . . . , m}. Since w, w 1 G B(L), zi, z[ G L 2 . Moreover, the reductions zi in L 2 /wL 2 
are linearly independent over the residue held. To show this, consider 

m 

^ diZi G wL 2 

i=s+l 

for d l G 0. Then 

m 

5^ d l vo t '- ri e t G w _1 (n7i 2 ) nn7 1 ~ I ' 1 Li = w^L, 

i=.s + l 

where we used the above lemme to obtain the equality. Considering the vectors zu *6i are basis 
vectors of L, we have di G wO . Hence the reductions Zi are linearly independent over the residue 
field. Similarly the reductions z[ are linearly independent. 

Now for i, j 6 {s + 1, . . . ,m} with i < j (so ti < tj), let x — ^e^ and y = w tj ~ Tl ej. Then the pair 
(x,y) satisfies the conditions (i) and (iii) of Proposition 17.61 and so u x , y € Hi(L). So we have 

i.e. 

ip(-/3(u~)yW -w,w)+ a u *' v (wj) = ip(-f3(u~*w' - w' , w') + a u *- v (w'j). 

Also the pair (x,y) satisfies the condition (iv) of Proposition 17.61 so by Lemmas 17. 9[ 17.101 and l7TTT| 

this gives 

iP(2(w(x),w(y)) 2 )=Tp(2(w'(x),w'(y)} 2 ). 
By replacing (x, y) by (ax, y) for any a £ O x , we still have the same equality, and hence have 

2(w(x), w(y)) 2 = 2(w'(x), w'(y)} 2 mod T r . 

Thus we have 

(w(m u - ri e l ) 1 w(zu t ^ ri e J )) 2 = {w' {m u -^e l ),w l {w t '~ ri e j )) 2 mod V r2+t \ 

i.e. 

(z i ,z j } 2 = {z' i ,z' j } 2 modV r2+u . 
By taking rriij = (z^, zj) 2 in Lemma 14.61 there exist elements z",...,z^ G L 2 such that 

z'l — z\ G V 1 for all i G {s + 1, . . . , m}; 

(z'i, z") 2 = (zi, Zj) 2 for all i, j G {r + 1, . . . ,m}. 
By Lemma T4.8[ there exists k G K 2 such that kzi = kz'/ for all i G {s + 1, . . . , m}. Define a e i by 



a(ej) 



for all i G {1, . . ., s}; 

ra7 -ti (2f - z-) for all i G {s + 1, . . . , m}. 

Indeed a E A thanks to z'( — z[ G "P* 1 . One can verify that 

[w + a)(ei) = kw(ei) for all z G {1, . . . , m}, 

so w' + a = kw. This completes the proof. □ 

Remark 8.4. In the above proof, the fact that the reductions Zi are linearly independent actually 
implies that dim V 2 > m — r. Namely i/dim V 2 < m—r, simply there is no w with w(L 2 ) + L\ = L . 
So in particular, if L C 2wL\, then we must that dimV2 > dimVi. 

Proposition 8.5. Assume the pair (Vi, (— , — )i) and (V 2 , (— , — ) 2 ) is such that V 2 is symplectic and 
dim Vi = dimV 2 — 2n. We give W = Vi ® V 2 Type 1 polarization, i.e. W + = Vi ® V 2 and W~ = 
Vi <8> V 2 . Assume L — w k Li for some k > 1 + e. Let w G B(L) be such that w(m~ r2 L 2 ) + Ly = L . 
Let M = M w = (w(tu _r2 Li) + L 2 )^ , so w G B(M). Assume w' G W is such that 
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• w'izu-^Lx) + L 2 = w(w- ri L!) + L 2 = M x ; 

• ip™ = 1P2 as characters of H2(M). 

Then there exists k G K\ such that A + w = k(A + w'). 

Proof. Assume dim Vi = dim V2 = 2n. Let {e\, . . . , e 2n } be a basis of L\ dual to {ei, . . . , e 2n }, i.e.- 
(ei,e1j) = w Vl Sij for all i,j G {l,...,2n}, so L = s-pa,n {m~ k e* +1 , . . . ,m~ k e 2 ' n }. Then w can be 
written as 

2n 

where v, L £L 2 - Hence 

w(ti7 _ri Li) + L 2 = span {ti7 _fe t;i, . . . , TZJ~ k v 2n } + L 2 . 

We define = w{w k ei) as in the previous lemma. Since the reductions are linearly independent, 
one can see that {vi, . . . ,v 2n } can be extended to an O-basis of L 2 by Lemma [4.41 But because 
dime> L\ = 2n, after all {i>i, . . . , v 2n } is an O-basis of L 2 . Thus we have 

w{m~ ri Li) + L 2 = spanQjTO^ui, . . . , m~ k v 2n }. 

So if we let {vl, . . . ,v 2n } be a basis dual to {vi, . . . ,v 2n }, i.e. (vi,v*) 2 = zu T2 Sij 7 then 

M = (w(m~ ri Li) + L 2 ) X = span {tn fc u*, . . . , w k v 2n } = zu k L 2 . 

Clearly M is admissible. Let {/1, . . . , f 2n } be a symplectic basis of V 2 , so for each i, either fi e 
or /i £ i^- Note that 

M = span {w fc /i, . . . , w k f 2n }. 
Now let w' £ B(M) be as in the proposition and let 

Ui = w(uj k fi) and u- = w'{m k fi). 

Let i, j G {1, . . . , 2n} be such that i < j. Also it satisfies the condition (iv). By arguing as in the 
previous proposition, we obtain 

{u i ,Uj) 1 = {u' l ,u' J ) 1 mod -p ri+fc . 

(Let us mention that in the previous proposition, to use Lemmas 17.101 and 17.121 we did not need to 
assume L is admissible because the polarization of W is of Type 1. But this time, we do need M to 
be admissible, because here we switch the roles of Vi and V 2 , i.e. "from the point of view of V2", the 
polarization of W is of Type 2. This is why we have to assume L is of the form vj k L\.) Next for 
i = j e {1, . . . , 2n}, let x = \f* and y — Tu k ~ r2 f*. The pair (x, y) satisfies the conditions (i) and (iii) 
of Proposition 17.81 and hence u x , y € H 2 {M). By arguing as before, we obtain 

(u l ,u i ) 1 = (u' i ,u' j ) 1 modP ri+k+e . 

Hence by Lemma POl there exist u'{, . . . , u 2n € L\ such that 

u-'-u-eP* 1 for all i G {1, . . . , 2n}; 

( u i>Uj) 1 = ( u i, u j)i fo r all i,j e {1, ...,2n}. 

Let k £ K 2 be defined by kui = ku" for all i G {1, . . . ,2n}. (Note that here unlike the previous 
proposition, we do not need Witt's extension theorem for lattices). Define a G A by 

a^) = vo~ tz (u" - u-) for all i G {1, ... , 2n}. 
Indeed a G A thanks to u" — u\ G V ti . One can verify that 

(11/ + a){ei) = kw(et) for all i G {1, . . . , 2n}, 
so w' + a = kw. This completes the proof. □ 
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9. A proof of the main theorem 

We are ready to give a proof of our main theorem on the Howe duality conjecture. Throughout 
this section, we assume that the unramificd pair (Vi, (— , — ) 1 ) and (V2, (— , — } 2 ) is such that 

• V2 is symplectic; 

• dimVi = dimV2 = 2n; 

• W = Vi ® V2 is given Type 1 polarization. 

Accordingly we write UiVi) = 0(2n) and U(V2) = Sp(2n). It is well-known that the group 0(2n) ■ 
Sp(2n) splits in the metaplectic cover Sp(W), and hence we view it as a subgroup of Sp(W / ). Also 
we may consider the Hecke algebra Hi (resp. H2) as the one for U(Vi) (resp. [/(V2)) rather than for 

U(Vi) (resp. tT(Va)). 

Let us make the following dehnition. 

Definition 9.1. Fix a self-dual lattice L\ C V\ with respect to a fixed integer n. We define the 
conductor of an irreducible admissible representation (n,V n ) of U(Vi) to be the sublattice L of L\ 
such that 

• Vj l(L ] ± 0; 

• y/ l(L ' } = for all V C L x with L' D L. 

Since the groups Ji(L) form a fundamental system of neighborhood of the identity of U(Vi), every 
irreducible admissible representation has a conductor. Also note that if L = w k L\ for some integer 
k, then J\{L) fits in the exact sequence 

-> Ji(L) -¥ 0(2n)(0) -> 0{2n){0/w 2k O). 

Then the main theorem is 

Theorem 9.2. Assume (n,V„) is an irreducible admissible representation ofU(Vi) whose conductor 
is of the form vj k L\ with k > 1 + e. If Q^(tt) 7^ 0, then it has a unique non-zero irreducible quotient. 

The rest of the section is devoted to a proof of this theorem. Our proof follows the arguments in 
jMVWI p.103-106]. 

Let us start with the following definition: For any lattice L C L\, define 

*(£) := {ip™ : w £ B(L) and w{vj- r2 L 2 ) +L X = L^}. 

Recall that for each w £ B(L), ipf is a character on Hi(L). Also we define 

V r [Hi(L),il>x] := {v e K : n(h)v = ^ 

i.e. the i?i(L)-isotypic component of 7r of type Then we have 

Lemma 9.3. Let L C 2wLi be a conductor of an irreducible admissible representation (7r,V^) of 
0(2n). Assume 0^(77) 7^ 0. Also let ^'(L) C ^(L) be the non-empty subset defined by 

= {Vi G : V^HxiL), fa] ^ 0}. 

K Jl(L) = V^Hx{L)M- 

Proof. This is Lemma in |MVW1 p. 104]. But we will give a proof for the sake of completeness. First 
let 

V'= V,r[JTi(L),lfrl] 
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We must show = V. But the inclusion V CV W is clear because the character tp™ is trivial 

on Ji(L) for all w G B(L) 

To show the inclusion C V' : it suffices to show ® Q^ir) CV'® Q^(w). To show this, 

we use the key first lemma (Proposition 17. 15l) and the maximality of the lattice L with respect to the 
property V^ 1 7^ in the following way: Let p : S — > 7T(£> 8^(71-) be the surjection. Since 7^ 0, 

the map p restricts to a nonzero surjective map 

p:S Jl ^ -+V^ L) ®6^(7r). 

By Proposition [733 we have S Jl ^ = lu(H 2 )Sl, so we have the surjective map 

p:uo{H 2 )S L ^V^ 

Hence the space V^ L ^ ® 0^,(7r) is generated by the vectors of the form p(s w ) for w G -B(£) under 
the action of the Hecke algebra T-L 2 - For each 10 G such that p(s w ) 7^ 0, if we show p(s w ) £ 

V'i'] < ^ ) ©'/'( 7r )' we wm De d° ne because this will imply V^ 1 ^ ®Q^{tt) C V'<g>0,/,(7r). Assume 
to the contrary that £>(s m ) G V^[-ffi(L), V , r]®®j/ , ( 7r )- Then we have w(m~ r ' 2 L 2 ) + Li C L x . By Lemma 
HQ there exists a lattice V such that L C L' C i x and w 6 S(i'). Then s w G Sl< C S Jl< - L '\ which 
implies p(su,) G F/ 1 ^ ^ ® 6^,(7r). But by the maximality property of L, we have V^ L ' = 0. □ 

For what follows, we fix w G J5(L) to be such that 

• w(m~ r2 L 2 ) + L 1 = L ± ; 

• V„[Hi(L) , tpf] 7^ 0, or equivalently p(su,) 7^ where p : S — > V^- <g> (71") is the surjective map. 
Also as we did in the previous section 

• M = M w := (w{w- ri L x ) + L 2 )^ , so w G B(M). 
Let us note that ip 2 ^ s a character on H 2 (M). 

For each smooth but not necessarily irreducible representation (ui,V ai ) of Z7(Vi), we define 

V ai := {v G V ai : a-i(fc)w = for all h G 

Similarly for each smooth representation (a 2 , V a2 ) of U(V 2 ), we define 

V a2 := {v G V a2 : cr 2 (/i)« = ^*(% for all h G H 2 (M)}. 

For each i = 1, 2, we let e$ G "Hi be the idempotent defined by 

. {[Ki-.H^fiu)- 1 for uGiTi 
ei(u) = < 

[0 for it G U(Vi) but u ^ Hi, 

where Hi — Hi(L) and H 2 = H 2 (M). Let us put 

Proposition 9.4. Lei (o"2,V^ 2 ) oe a fnoi necessarily irreducible) smooth non-zero representation of 
U(V 2 ), and p : S — > V n ® V^- 2 a surjective U(Vi) x U(V 2 ) -intertwining map. Then V a , 2 7^ and we 
/lave i/ie equality 

Vtx ® V a2 = n(Hi)p{s w ) = o- 2 (H 2 )p{s w ), 

where w is as fixed previously. 

This lemma corresponds to Lemma [MV W, p. 104]. But since we do not have the V2-analogue of 
Proposition I7.15[ our proof slightly differs from the one in [MVW . We need a couple of lemmas to 
prove the proposition. 

Lemma 9.5. Let M = vo k L 2 with k > 1 + e and N be a lattice with N C M. Then H 2 {N) C H 2 (M). 
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Proof. In what follows, we will construct an element in H2(M) not in H2(N). Since N C M, there 
exists v £ L 2 with ordz, 2 (v) = and w k v £ M\N . There exists an integer s > such that w k+s v £ N 
but zu k+s ^ 1 v N. Then -co~ k ~ s v* £ N A -\M ± , where v* is the vector dual to v, i.e. (v,v*) 2 = vj' 1 " 2 . 

So v* £ L 2 and ordL 2 (v*) = 0. Let x = ro ' 2 r2 v and y = v* . The pair (x,y) satisfies the conditions 
(i) and (iii) of Proposition [7761 (with, of course, L, L\ and r\ replaced by M, L 2 and r 2 , respectively), 
and hence u xy exists and (u x y — tyM 1 - C L 2 . Also since x £ L 2 and y £ L 2 , one can see u xy is in 



Lemma 9.6. Assume M = m k L 2 . Let w £ W be arbitrary. If H 2 (M) acts on s w via some character, 
then w £ B(M) i.e. s w £ Sm- 

Proof. If H 2 (M) acts on s w via a character, we have to £ swpp(uj(h)s w ) for all h £ H 2 (M), i.e. 
uj(h)s w (w,0) 7^ 0. But uj(h)s w (w,0) = s w (h~ 1 w, a u (w)) 7^ 0, which implies h^ 1 w £ A + w. So 
(ft - l)w £ A. Now assume w <£ B(M). Then wiw'^Lx) % M^. Let TV = (M 1 - + to^"".^))- 1 , 
soJVCM and to G B(iV). Then (ft - VjN 1 - C L 2 , and so ft e ff 2 (iV) for all ft G # 2 (M), which 
would imply H 2 (N) — H 2 (M). By the above lemma, we must have N — M . But N C M, which is a 
contradiction. So w £ B(M). □ 

Now we are ready to prove Proposition 19.41 

Proof of Proposition [7977/} First we will show V v (8> V a2 = tt{Hi)p(s w ). The argument is the same as 
in |MV W . but we will repeat it here. 

Since V n C V^ L \ and we know S Jl( - L ^ = u>(%2)Sl by Proposition l7.15[ by taking Lemma [9731 into 
account, we can conclude that V ^ ® V„ 2 is generated under the action of H2 by the elements of the 
form q(s w ,) with w' £ B(M), w' (m- r2 L 2 ) + Li = L 1 - and tpf' = ipf. By Proposition [8731 there exists 
k £ K 2 such that A + w = k(A + to'), which implies s w is proportional to uj(k)s w >. Thus V n (g> V CT2 is 
generated by q(s w ) under % 2 - The group .ff 2 (M) acts on s w via the character ip 2 > and so V a2 7^ 0. 
So we have 



Let to' G W be such that p(s w /) 7^ 0. (Note that viewed as a representation of the compact group 
H 2 (M), the space S of the Weil representation can be decomposed as S = S"©kerp for some subspace 
S", where both S' and kerp are spaces of representations of H 2 (W). Hence we may assume s w > G S' .) 
If p(s w >) G V„ ® K CT2 , then the group H 2 (M) has to act on p(s„;') via the character i/)^ 1 , which implies 
H 2 (M) acts via the character ip 2 on s m / because we assume s w > £ S'. By Lemma [9.61 s w / £ Sm, 
which implies the space Sm surjects on V n <g> V " CT2 . Hence the space V n <g> V CT2 is generated under 7ii 




□ 



® Kr 2 = 0- 2 {'H.2)p{s w ) = 0- 2 (H 2 e 2 )p(s w ), 

because e 2 = 1 and <X2(e2)p(su,) =p(su,). Considering cr 2 (e 2 )V2 = Vo- 2 ) we have 

F w (8 F ff2 = o- 2 (e 2 )(V„ ® y CT2 ) = «T 2 (Wa)p(a„). 
Next we will show the equality 

V^tgiF^ =7r(Wi)p(a w ). 
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by p(s w ,) with it/ G B(M) and ipf = iffi . We will show if p(s w >) ^ 0, then w'{-cu-' ri Li) + L 2 = M^. 
Assume w'(w^ ri Li) + L 2 ^ M^, i.e. w'(m- ri Li) + L 2 C M^. Let L' C (it/(ra- r2 L 2 ) + ii)^. Note 
that w' (w~ r2 L 2 ) |Ii C L , i.e. L C L'. Also for any wo G W we have the bijection 

Li/(wo(n7 _r2 i 2 ) + = (^(w-^Lx) + Li) /Li. 
(See [MVW1 Sous-lemme, p. 105].) Hence by choosing wq = w' we have 

[L 1 :L'} = [w'(w- ri L 1 ) + L 2 :L 2 } 7 
and by choosing wq — w, we have 

[Li : L] = [M x : L 2 ]. 

But w' (vj~ ri L\) + L 2 C A/- 1 by our assumption on it/, so [ii : Z/] < [L\ : L}. Hence L C L'. 
Now it/ G B(L'), so Ji(L') acts trivially on s^,' and hence on p(s w >). Hence V n Jl< " L ^ ^ 0. But by 
our assumption ' = for any L' with i C L' , which is a contradiction. Therefore we have 

w' (vj~ ri L\) + L 2 = M . Using Lemma [8.51 as above, one can see that s w > is a scalar multiple of 
Lu(k)s w for some k G K\. Arguing as above, one have the desired equality. □ 

Once Proposition 19.41 is proven, the rest follows from the following general fact. 

Lemma 9.7. Let E be a complex vector space, and A, B be subalgebras of the endomorphism algebra 
Endc(-E), viewed as a C-algebra. Assume A and B commute pointwise and there exists e G E such 
that Ae = Be. Then A is the centralizer of B in Endc(-E) and vise versa. 

Proof. This is nothing but Lemma in p. 106 of |M VW) . □ 

We apply this lemma as follows. First assume Oip(it) has more than two non-zero irreducible 
quotients, say (ir 2 , V^ 2 ) and (ir' 2 , K-'). Let (a, V a ) be the representation of U(V 2 ) given by a = tt 2 +tt' 2 
and V a = Kr 2 + V„' , so we have the surjection 

p : S V w <g> V a . 

By Proposition 19. 4\ we have 

V-* % V a = F OT <g> V m + V m ® V n > 2 = n(Hi)p{s w ) = <r(H 2 )p(s w ). 

Let 

be the projection on the first component. Then q commutes with the action of Hi. By applying 
Lemma [9~7l with A = n(Hi), B = o-(H 2 ), E = V ^ ® V a and e = p(s w ), one can conclude that 
q G tt('Hi), i.e. q = ir(ip) for some if G Hi. But then 

q(V^ ® V a ) = n(<p)V„ ® Va + Vv <g> V^ , 
which is a contradiction. This completes the proof of the main theorem. 

10. Lifting to smaller rank groups 

We will close up this paper with the following theorem. 

Theorem 10.1. Let (U (Vi) , U (V 2 )) be an unramified dual pair with V 2 symplectic. Further assume 
dimV2 < dimVi. fdimVi can be even or odd.) 7/(^,1/^) is an irreducible admissible representation 
ofU(Vi) with the property that 

yJx{L) = o 

for all L 3 2wLi, i.e. the conductor is smaller than 2wLi. Then Q^{tt) = 0. 
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Proof. Let L be the conductor of tt, so L C 2zuL\. Assume <d^(ir) ^ 0, and let p : 5 — > V w <8 0^(7r) 
be the surjection. By Proposition 17.151 we know S Jl ^ L ' — u>('H2)Sl, and hence under p, the space 
luCH 2 )Sl surjects on V* ® Q^,(7r). So for some u> € B(L), we have p(s w ) 7^ 0. The group H\{L) 
actsonp(su,) via the character ijjf . Hence by Lemma l9.3l we must have w{vj~ r2 L2) +L% = L 1 -. (Note 
that the proof of Lemma 1931 goes through without requiring Vi be even.) Then the conditions for 
Proposition l8.3l are satisfied, and hence by reasoning as in the first part of the proof of the proposition, 
one can see that the images of w(vj~ ri L) in LijwLi have to span dim Vi-dimensional space over the 
residue field. But this is impossible because dimL 2 /wL 2 = dimV2 < dimVi. (Also see the first 
rcmaker after Proposition 18.31 ) The theorem follows. □ 
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